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TITLE 



AUTOMATIC REARVIEW MIRROR , VEHICLE LIGHTING CONTROL 
AND VEHICLE INTERIOR MONITORING SYSTEM 
5 USING A PH OTOSENSOR ARRAY 

This application is a continuation-in-part of co- 
pending International Patent Application No. 
PCT/US94/01954, which designates the United States and 
10 which was filed February 25 , 1994 and which is a 
continuation-in-part of co-pending U.S. Patent 
Application Ser. No. 08/023,918, filed Feb. 26 , 1993 



BACKGROUND OF THE INVENTION 

15 

Field of the Invention 



This invention relates to an automatic rearview mirror 
system for automotive vehicles which automatically 

2 0 changes reflectance level in response to glare causing 
light, and more particularly relates to an improved 
automatic rearview mirror system using only a 
rearwardly facing sensor. This invention further 
relates to an automatic rearview mirror and vehicle 

25 interior monitoring system for automotive vehicles 

which also monitors a vehicle interior or compartment. 
This invention further relates to an automatic rearview 
mirror and vehicle interior monitoring system for 
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automotive vehicles which may also be used as a vehicle 
intrusion detection system or as a compartment image 
data storage system. This invention further relates to 
an automatic rearview mirror and a vehicle lighting 
5 control system using an image sensor, such as a 
photosensor array. 

Description of Related Art 

10 Automatic rearview mirrors and mirror systems have been 
devised for varying the reflectance level of a variable 
reflectance rearview mirror by reducing the reflectance 
automatically in response to annoying glare light, as 
seen rearwardly of the rearview mirror or mirrors by a 

15 driver of the vehicle, and by increasing automatically 
the reflectance to a normal or maximum reflectance 
level when the annoying glare light subsides. These 
automatic mirrors have been changed over the years in 
an effort to improve their performance characteristics 

20 and associated level of glare protection. 

Early automatic rearview mirrors used a rearwardly 
facing sensor and control circuit to change mirror 
reflectance. One example of such a "single-sensor" 

25 type mirror is described in U.S. Patent No. 4,266,856. 
In these prior art single-sensor type mirrors, the rear 
glare light was incident on a rearwardly facing sensor 
or photocell, such as a photodiode, photoresistor or 
phototransistor . These mirrors suffered from various 

30 problems, however, including the problem that these 
mirrors would become increasingly sensitive ' and even 
"lock-up" in their minimum reflectance level or state 
as the driver encountered significantly higher light 
levels in town or city driving. This required the 

35 driver to repeatedly adjust the mirror's sensitivity 
control to prevent such problems. 
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To overcome the problems of single-sensor type mirrors, 
a non-rearwardly facing photocell for sensing "ambient" 
light was added. It was believed that the desired 
reflectance necessary to relieve the driver from glare 
5 depended not only on glare light but also on ambient 
light. Accordingly, these "two-sensor" type mirrors 
used two separate photocells, one generally facing 
rearwardly and one generally facing forwardly (or other 
non-rearwardly facing direction) of the mirror or 

10 vehicle. The signals from these two photocells were 
then compared in some fashion, and when, for example, 
the glare light from the rear was comparatively high 
with respect to the "ambient" light, a control circuit 
would apply a control signal to reduce mirror 

15 reflectance. Some examples are described in German 
Laid-Open Patent No. 3,041,692; Japanese Laid-open 
Patent No. 58-19941; and U.S. Patents Nos. 3,601,614; 
3,612,666; 3,680,951; 3,746,430; 4,443,057; 4,580,875; 
4,690,508; and 4,917,477. In many of these prior art 

20 automatic rearview mirrors, light generally forward of 
the mirror or vehicle was incident on the second 
photocell. 

These arrangements, however, also had problems. In 
25 some of these mirrors the forwardly facing or "ambient" 
light sensor was inaccurate because it did not 
correctly measure ambient light levels since it did not 
include light generally rearward of the mirror or 
vehicle. Some examples include the devices described 
30 in U.S. Patent Nos. 4,443,057 and 4,917,477. Other 
prior art devices overcame these deficiencies by 
providing a control circuit which correctly measured 
ambient light as a combination of both the forward and 
rear light levels. Examples of this significantly 
3 5 different approach are described in U.S. Patent Nos. 
4,793,690 and 4,886,960. 
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The prior art two-sensor type systems generally 
provided improved performance over prior art single- 
sensor type systems but were also more complex and 
costly. In part, this was because using separate 
5 forwardly and rearwardly facing photocells required 
that the performance characteristics of the two 
separate photocells, such as photoresistors, be matched 
appropriately to ensure consistent performance under 
various operating conditions. Matching photocells such 
10 as photoresistors, however, generally involves complex, 
expensive and time consuming operations and procedures. 

Both the prior art single-sensor and two-sensor type 
mirrors presented additional problems when they were 

15 also used to control the exterior side view mirrors. 
This is because such prior art systems used a common 
control or drive signal to change the reflectance level 
of both the interior rearview mirror and the exterior 
left and/or right side view mirrors by substantially 

20 the same amount. In U.S. Patent No. 4,669,826, for 
example, a single-sensor type mirror system used two 
rearwardly facing photodiodes to control both an 
interior rearview mirror and the left and/ or right side 
view mirrors based on the direction of incident light 

25 from the rear. Another example includes the two-sensor 
type system described in U.S. Patent No. 4,917,477. 

In rearview mirror systems , however, each of the 
interior rearview and exterior side view mirrors may 

30 reflect different source light levels. More 

specifically, the inside rearview mirror, left side 
view mirror and right side view mirror each enable the 
driver to view a different portion or zone of the total 
rearward area. Of course, there may be some overlap of 

3 5 the image information contained in each of the three 
zones. The situation is further complicated with 
multi-lane traffic because each of the mirrors reflects 
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different light levels caused by the headlights of the 
vehicles which are following, passing or being passed. 
As a result, in the prior art systems, when the 
reflectance level of the interior rearview mirror was 
5 reduced to decrease the glare of headlights reflected 
therein, the reflectance level of the exterior left and 
right side view mirrors was also reduced by 
substantially the same amount, even though, for 
example, the side view mirrors might not be reflecting 
10 the same level of glare light, if any. Accordingly, 
rear vision in the exterior left and right side view 
mirrors could be improperly reduced. 

Other prior art two-sensor type systems used a common 
15 ambient light sensor and several rearwardly facing 
sensors, one for each of the mirrors. An example is 
the alternate system also described in U.S. Patent No. 
4,917,477. This approach is not satisfactory, however, 
because it reduces system reliability and increases 
20 complexity and cost. 

Finally, some prior anti-glare mirrors used several 
sensors to control the segments of a variable 
reflectance mirror. One example is disclosed in U.S. 

25 Patent No. 4,632,509, which discloses a single-sensor 
type mirror using three rearwardly facing photocells to 
control three mirror segments depending on the 
direction of incident light from the rear. See also 
U.S. Patent No. 4,697,883. These prior mirror systems 

30 generally have the same problems as the other single- 
sensor type mirrors. Some other anti-glare mirrors are 
generally disclosed in U.S. Patent Nos. 3,986,022; 
4,614,415; and 4,672,457. 

35 Consequently, there is a need for an automatic rearview 
mirror system for an automotive vehicle having improved 
reliability and low cost, which accurately determines 
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or otherwise discriminates light levels that the driver 
will experience as glare without the need for a 
separate forwardly facing photocell. In addition, as 
noted above, there is also a need for an automatic 
5 rearview mirror system of high reliability and low 

cost, which accurately determines light levels that the 
driver will experience as glare, and which can control 
independently the reflectance of a plurality of mirrors 
according to the light levels actually reflected by 

10 each of the rearview and exterior side view mirrors 

without the need for additional and separate rearwardly 
facing photocells. There is also a need for an 
automatic rearview mirror system that can independently 
control the segments of a variable reflectance mirror 

15 while accurately determining light levels that the 

driver will experience as glare in each segment of the 
mirror without the need for additional and separate 
forwardly and rearwardly facing photocells. 

2 0 One concern with automatic rearview mirror systems, as 
well as other systems having sensing, control or logic 
circuits located in the rearview mirror, is that 
differences in vehicle design and mirror field of view 
requirements may result in rearview mirrors having a 

25 variety of appearances (or finishes) , forms (or shapes) 
and sizes. These variations generally require the re- 
design and re-tooling of a number of the components or 
sub-assemblies of the rearview mirror head assembly. 
However, it is generally desirable to reduce the number 

30 of components or sub-assemblies of the rearview mirror 
head assembly so as to reduce cost, product development 
lead time and manufacturing complexity. To achieve 
this in automatic rearview mirrors, as well as other 
systems having sensing, control or logic circuits 

35 located in the rearview mirror, it is desirable to 
locate the sensing, control or logic circuits and 
related components in a housing or module, which is 
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attached, connected, made integral with or otherwise 
associated with the rearview mirror mounting bracket 
means or structure so that a common design of a 
mounting bracket sub-assembly for a rearview mirror may 
5 be used with a variety of rearview mirror head 
assemblies. 

Vehicle lighting systems may include a variety of 
vehicle lights, including low intensity peripheral or 

10 side lights that allow other vehicle drivers to see the 
vehicle in lower light conditions, high intensity 
headlights that operate in a low beam mode or a high 
beam mode for general night driving, and fog lights 
that provide low ground lighting with less back 

15 scattering to improve the driver's views in adverse 
weather conditions, such as fog, rain and snow. 
Vehicle lighting systems may also include headlights 
having an intermediate or mid beam mode, as well as the 
low and high beam modes. Vehicle lighting systems may 

2 0 also include vehicle running lights, which are vehicle 
headlights that are operated at an appropriate 
intensity to improve the ability of other vehicle 
drivers to see the vehicle during the day. Vehicle 
running lights may also be used for lower lighting 

25 conditions, such as certain adverse weather conditions 
or other lower visibility conditions. 

Thus, as the number of vehicle lighting options has 
increased, it has become more complex for the driver to 

30 determine the appropriate vehicle lighting 

configuration and to operate or control the vehicle 
lighting systems. Therefore, improved vehicle lighting 
control systems are required that may operate with 
other systems, such as automatic rearview mirror 

35 systems and vehicle interior monitoring systems, or as 
stand-alone systems. 
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Finally, unauthorized vehicle intrusion for the purpose 
of stealing the vehicle or its contents is a 
significant problem. Each year, automotive 
manufacturers are including vehicle anti-theft or 
5 intrusion detection systems on more vehicles to deter 
potential intruders and to prevent the theft of 
vehicles or their contents. Currently known vehicle 
anti-theft systems are generally designed to protect 
the vehicle or its contents from theft or vandalism. 

10 There are many versions of vehicle anti-theft systems 
using various sensor technologies that attempt to deter 
theft or vandalism using the horn, siren or flashing 
lights, or other alarm mechanisms to bring attention to 
a vehicle. As is known, existing intrusion detection 

15 systems for vehicles use sensor technologies that have 
various limitations, including the problem of false 
triggering. For example, in many cases active vehicle 
alarms are simply ignored by people who assume that the 
alarm was falsely triggered. The proliferation of 

20 separate automatic rearview mirror systems and vehicle 
intrusion detection systems is also costly. Therefore, 
vehicle intrusion detection systems using an improved 
sensor technology are required that operate in 
combination with other vehicle systems (such as 

25 automatic rearview mirror systems) or that operate 
independently . 

Even with such anti-theft systems, recovered stolen 
vehicles typically provide little or no evidence of the 

3 0 vehicle thief. Therefore, systems are required that 
provide an image of the vehicle thief that would be 
useful to law enforcement and the insurance industry as 
an aid in identifying the person (s) responsible for the 
vehicle theft, and that operate in combination with 

35 other vehicle systems (such as automotive rearview 
mirror systems)- or that operate independently. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to overcome 
the problems of the prior art. 

5 

It is another object of the present invention to 
provide an automatic rearview mirror system of improved 
reliability. 

10 It is yet another object of the present invention to 
provide an automatic rearview mirror system that 
accurately determines light levels that the driver will 
experience as glare without the need for a separate 
forward facing sensor or other non-rearwardly facing 

15 photocells. 

It is another object of the present invention to 
provide an automatic rearview mirror system of high 
reliability that accurately determines light levels 
20 that the driver will experience as glare, and which can 
independently control a plurality of mirrors or mirror 
segments according to different fields of view without 
the need for additional and separate rearwardly facing 
photocells. 

25 

According to one aspect of the present invention, using 
a photosensor array and an appropriate control circuit 
allows the elimination of separate forwardly facing or 
other non-rearwardly facing photocells, thereby 
30 allowing for lower costs and increased reliability 
since it is not necessary to match two separate 
photocells such as photoresistors. 

According to another aspect, the present invention 
35 which achieves one or more of these objectives relates 
to a control system for controlling a plurality of 
variable reflectance mirrors or mirror segments which 
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change their reflectance in response to a signal from a 
drive circuit. The system comprises a plurality of 
variable reflectance mirrors, a photosensor array and a 
control circuit receiving signals from the photosensor 
5 array for controlling the mirrors. The photosensor 
array is mountable to view rearwardly of the mirror or 
vehicle. The photosensor array comprises a plurality 
of sets of photosensor elements corresponding to the 
plurality of variable reflectance mirrors. The 

10 photosensor elements in each set produce a plurality of 
photosensor element signals in response to light 
incident thereon. The control circuit determines 
control signals, indicative of a desired reflectance 
for each of the plurality of variable reflectance 

15 mirrors, in response to receiving photosensor element 
signals from the photosensor element set for each view 
or zone corresponding to the rearview mirror and 
exterior side view mirrors and also (or alternatively) 
the mirror segments. The control signals control the 

20 drive circuit to cause the plurality of variable 

reflectance mirrors or mirror segments to assume the 
desired reflectance. 

According to another aspect, the present invention 
25 which achieves one or more of these objectives relates 
to an automatic rearview mirror system for an 
automotive vehicle comprising at least one variable 
reflectance rearview mirror, and an array of sensing 
elements to sense light levels in an area rearward of 
30 the at least one variable reflectance rearview mirror. 
Each of the sensing elements is adapted to sense light 
levels of light incident thereon and to output an 
electrical signal indicative of the sensed light 
levels. The system further comprises a signal 
35 processor, connected to the array of sensing elements, 
receiving and using the electrical signals indicative 
of the sensed light levels from the sensing elements to 
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determine a first electrical signal indicative of a 
background light level in the area rearward of the at 
least one variable reflectance rearview mirror and to 
determine a second electrical signal indicative of at 
5 least one peak light level in the area rearward of the 
at least one variable reflectance rearview mirror. The 
signal processor determines at least one control signal 
indicative of the desired reflectance level of the at 
least one variable reflectance rearview mirror from the 

10 first electrical signal indicative of the background 

light level and the second electrical signal indicative 
of the at least one peak light level. The system 
further comprises at least one drive circuit connected 
to the signal processor and to the at least one 

15 variable reflectance rearview mirror for receiving the 
at least one control signal and generating and applying 
at least one drive signal to the at least one variable 
reflectance rearview mirror to drive the at least one 
variable reflectance mirror to the desired reflectance 

2 0 level. 

According to another aspect, the present invention 
which achieves one or more of these objectives relates 
to a control system for controlling a plurality of 

25 variable reflectance mirrors, each of which change 

their reflectance level in response to a drive signal 
from an associated drive circuit, for an automotive 
vehicle. The system comprises a plurality of variable 
reflectance mirrors, and a photosensor array mountable 

30 to face substantially towards a rear area. The 

photosensor array comprises a plurality of photosensor 
element sets. Each set comprises a plurality of 
photosensor elements. Each of the photosensor elements 
generates a photosensor element signal indicative of a 

35 light level of light incident thereon, and each of the 
sets corresponds to one of the plurality of variable 
reflectance mirrors. The system further comprises a 
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control circuit, connected to the photosensor array, 
for determining and applying a plurality of control 
signals. Each of the control signals is indicative of 
a desired reflectance level for each of the plurality 
5 of variable reflectance mirrors in response to 

receiving the photosensor element signals from each of 
the plurality of photosensor element sets. The system 
further comprises a plurality of drive circuits 
connected to the control circuit and to different ones 

10 of the plurality of variable reflectance mirrors 

associated therewith. Each of the control signals is 
output to the drive circuit associated therewith, to 
generate and apply a drive signal to each of the 
plurality of variable reflectance mirrors causing each 

15 of the mirrors to assume a desired reflectance level. 

According to another aspect, the present invention 
which achieves one or more of these objectives relates 
to a control system for controlling at least one 

2 0 variable reflectance mirror for an automotive vehicle. 

The system comprises photosensor array means for 
sensing light levels in an area rearward of the at 
least one variable reflectance mirror and generating 
photosensor array signals, means for determining a 
25 background light signal from the photosensor array 

signals, means for determining a peak light signal from 
the photosensor array signals, and means for 
controlling a reflectance level of the at least one 
variable reflectance mirror using the background and 

3 0 peak light signals. 

According to another aspect, the present invention 
which achieves one or more of these objectives relates 
to a method of controlling the reflectance of at least 
35 one variable reflectance mirror comprising the steps of 
sensing light levels in an area rearward of the at 
least one variable reflectance mirror with an array of 



- 13 - 

sensing elements, determining a background light level 
from the sensed light levels, determining a peak light 
level from the sensed light levels, and controlling a 
reflectance level of the at least one variable 
5 reflectance mirror using the determined background and 
peak light levels. 

By using a plurality of photosensor element sets or 
sub-arrays on a photosensor array to control a 
10 plurality of mirrors and also (or alternatively) mirror 
segments, the mirrors may be controlled independently 
to vary their reflectance in accordance with the view 
associated with each of the photosensor element sets or 
sub-arrays . 

15 

According to another aspect the present relates to an 
automatic rearview mirror system for an automotive 
vehicle comprising a variable reflectance rearview 
mirror, a photosensor array means for sensing light 

2 0 levels in an area rearward of said variable reflectance 
rearview mirror and for generating photosensor array 
signals, a signal processing means for receiving said 
photosensor array signals and for determining from said 
photosensor array signals a signal for controlling said 

25 variable reflectance rearview mirror, and a mounting 
bracket means for attaching said variable reflectance 
rearview mirror to said automotive vehicle, said 
mounting bracket means further comprising a housing 
means for housing said photosensor array means and said 

30 signal processing means. 

According to another aspect the present relates to a 
vehicle lighting control system for controlling a 
vehicle lighting system in an automotive vehicle 
35 comprising a photosensor array means for sensing light 
levels in a forward field of view and generating a set 
of photosensor array signals, and a signal processing 
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means coupled to said photosensor array means for 
receiving said set of photosensor array signals and 
determining from said set of photosensor array signals 
at least one control signal for controlling said 
5 vehicle lighting system. 

According to another aspect, the present invention 
relates to a control system for monitoring a vehicle 
interior and for controlling at least one variable 

10 reflectance mirror for an automotive vehicle* The 
system comprises photosensor array means for sensing 
light levels in an area rearward of said photosensor 
array means and generating at least a first set of 
photosensor array signals, first determining means 

15 coupled to said photosensor array means for receiving 
said at least a first set of photosensor array signals 
and determining from at least a portion of said at 
least a first set of photosensor array signals a first 
signal for controlling said at least one variable 

20 reflectance mirror, second determining means coupled to 
said photosensor array means for receiving said at 
least a first set of photosensor array signals and 
determining at least a first set of values indicative 
of said at least a portion of said at least a first set 

25 of photosensor array signals, and memory means coupled 
to said second determining means for receiving and 
storing said at least a portion of said at least a 
first set of photosensor array signals* 

30 According to another aspect, the present invention 
relates to a vehicle intrusion detection system for 
detecting movement within a vehicle interior for an 
automotive vehicle. The system comprises photosensor 
array means for sensing light levels in an area 

35 including at least a portion of a vehicle interior and 
generating at least a first set and a second set of 
photosensor array signals, determining means coupled to 
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said photosensor array means for receiving said at 
least a first set and a second set of photosensor array 
signals and determining at least a first set and a 
second set of values indicative of said at least a 
5 first set and a second set of photosensor array 
signals, and comparing means coupled to said 
determining means for receiving said at least a first 
set and a second set of values indicative of said at 
least a first set and a second set of photosensor array 
10 signals and comparing said at least a first set and a 
second set of values to generate at least one output 
control signal indicative of the correlation between 
said at least a first set and a second set of values. 

i y 

15 According to another aspect, the present invention 

relates to a compartment image data storage system for 
an automotive vehicle. The system comprises 
:a F photosensor array means for sensing light levels in at 

least a portion of a vehicle compartment and generating 
20 at least a first set of photosensor array signals, 
li determining means coupled to said photosensor array 

yj means for receiving said at least a first set of 

photosensor array signals and determining at least a 
first set of values indicative of said at least a first 
25 set of photosensor array signals, and memory means 
coupled to said determining means for receiving and 
storing said at least a first set of values indicative 
of said at least a first set of photosensor array 
signals. 

30 

These and other objects, advantages and features of the 
present invention will be readily understood and 
appreciated with reference to the detailed description 
of preferred embodiments discussed below together with 
35 the accompanying drawings. 
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RRTEF DESCRIPTION OF THE DRAWINGS 

Figure 1A is a drawing of an automatic rearview mirror 
of the present invention, including an expanded view of 
5 a rearwardly facing photosensor array located in the 
upper center area of the mirror surface; 

Figure IB is another drawing of an automatic rearview 
mirror of the present invention, including an expanded 
10 view of the rearwardly facing photosensor array 

alternatively located in a bezel or chin of the mirror; 

Figure 1C is a diagram of an automatic rearview mirror 
of the present invention, in which the photosensor 
15 array and logic and control circuit are located in a 
housing or module that is attached, connected, made 
integral or otherwise associated with the rearview 
mirror mounting bracket structure; 

20 Figure ID is a side sectional view of the automatic 
rearview mirror of Fig. 1C; 

Figure 2 is a drawing of an automotive vehicle with the 
automatic rearview mirror system of the present 
25 invention; 

Figure 2A is an illustrative diagram of a rearward area 
of a vehicle interior as viewed by the photosensor 
elements of the photosensor array for monitoring the 
3 0 vehicle interior; 

Figures 3 A and 3B are illustrative diagrams of a 
rearward area as viewed by the photosensor elements of 
the photosensor array; 

35 

Figure 4A is a generalized diagram of a photosensor 
array PA(N,M) having a sub-array S(X); 
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Figure 4B is a generalized diagram of the photosensor 
array PA(N,M) and sub-arrays S(0), S(l), S(2) and S(3); 

Figure 5 is another schematic diagram of the 
5 photosensor array commonly located on a light sensing 
and logic circuit; 

Figure 6 is a schematic block diagram of the automatic 
rearview mirror system; 

10 

Figure 6A is a schematic block diagram of the automatic 
rearview mirror and vehicle interior monitoring system; 

Figure 6B is a schematic block diagram of a vehicle 
15 lighting control system having a photosensor array that 
has a forward field of view; 

Figure 7 is a flow chart illustrating the method of the 
present invention for controlling the reflectance of a 
2 0 rearview mirror or mirrors; 

Figures 8A and 8B are detailed flow charts for steps 
S150, S160 and S180 of Fig, 7; 

25 Figure 9 is a flow chart of the general logic flow of 
Figs. 7, 8A and 8B for controlling the reflectance of 
three mirrors; 

Figure 10 is another schematic block diagram of the 
30 automatic rearview mirror system of the present 
invention; 
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Figure 10A is a schematic block diagram of the 
automatic rearview mirror and/ or vehicle interior 
monitoring system of the present invention; 

5 Figure 11A illustrates the normalized spectral response 
of the photosensor array made using a non-epitaxial 
silicon process; 

Figure 11B illustrates the normalized spectral response 
10 of the photosensor array made using an epitaxial 
silicon process; 

Figure 12 is a flow chart illustrating the method of 
the present invention of the vehicle interior 
15 monitoring system; 

Figure 12A is a flow chart illustrating the method of 
the present invention for a vehicle intrusion detection 
system configuration of the vehicle interior monitoring 
20 system of Fig, 12; 

Figure 12B is a flow chart illustrating the method of 
the present invention for the compartment image data 
storage system configuration of the vehicle interior 
25 monitoring system of Fig. 12; and 

Figures 13A, 13B, 13C and 13D are flow charts 
illustrating the method of the present invention for 
controlling a vehicle lighting system. 

30 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENT 
I. The Automatic Rearview Mirror System 

35 

Figure 1A illustrates an automatic rearview mirror 1 
comprising a variable reflectance mirror element la and 
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a single rearwardly facing photosensor 2. The 
photosensor 2 is mounted facing rearwardly of the 
rearview mirror 1 so that its field of view encompasses 
an area comprising a rear window area and at least a 
5 portion of either or both side window areas. Also 
shown is a switch 3 to allow a driver to manually 
control several possible mirror functions, such as an 
on-off control switch, a sensitivity adjustment and a 
f orce-to-day or a force-to-night switch ( i . e • , forced 

10 maximum or minimum reflectance levels, respectively). 
An expanded view of the photosensor 2, which is 
preferably located in an upper center area of the 
variable reflectance mirror element la as shown, shows 
a light sensing and logic circuit 26 comprising a 

15 photosensor array 32 and a logic and control circuit 34 
(which is not shown in Fig. 1A but is shown in Figure 6 
as discussed below) . A photosensitive surface of each 
of the photosensor elements 32a (shown in Fig. 5) of 
the photosensor array 32 senses light levels or image 

20 information in a predetermined field of view 

encompassing an area located rearwardly of the rearview 
mirror 1. A lens 30 images or otherwise focuses the 
light information from the predetermined field of view 
onto the photosensor array 32. 

25 

The rearview mirror 1 further comprises a channel mount 
lb or other mounting means used to fixedly attach the 
mirror 1 to the windshield or headliner area of the 
vehicle. The rearview mirror 1 is generally adjustable 
3 0 with respect to the channel mount lb to allow a driver 
to position the mirror for correct viewing of the 
rearward area or scene so that the driver's sightline 
through the rearview mirror 1 is aligned approximately 
with the vehicle's center line. 

35 

Preferably, the photosensor 2 is fixedly mounted on the 
adjustable portion of the rearview mirror 1 as shown in 
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both Figs. 1A and IB so that the viewing axis of the 
photosensor 2 is generally aligned with the viewing 
axis of the mirror 1 which is perpendicular to the 
glass surface of the mirror 1. This approach is 
5 preferable both because of packaging concerns and 
because it provides a guaranteed sightline. It is, 
however, within the scope of the present invention to 
mount the photosensor array 32 so that it is movable 
with respect to the variable reflectance mirror element 
10 la of the rearview mirror 1. 

More preferably, as shown in Fig. 1A, the photosensor 2 
is located in the upper center area of the variable 
reflectance mirror element la. This may be required, 

15 for example, if it is necessary to reduce the bezel 

size of the rearview mirror 1. If the photosensor 2 is 
located behind a glass surface of the variable 
reflectance mirror element la, an appropriately sized 
hole is provided in the protective and reflective 

20 materials of the variable reflectance mirror element 
la. Additionally, a corresponding area within an 
active layer of the variable reflectance mirror element 
la may be removed or otherwise rendered inactive to 
enable the photosensor 2 to view directly the rearward 

25 scene. Alternatively, for manufacturing reasons, the 
photosensor 2 may view the rearward scene through the 
active layer of the variable reflectance mirror element 
la, in which case it is preferable to compensate for or 
otherwise negate the effects of reducing reflectance 

30 and correspondingly the transmittance of the variable 
reflectance mirror element la so that the photosensor 2 
effectively views the rearward scene directly as will 
be described later. 

3 5 Most preferably, a reflective surface is maintained 
within the hole to both preserve the cosmetic 
appearance of the assembly as viewed by the driver and 
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to maximize the reflective surface. This can be 
achieved by providing a very thin metal reflective 
layer (100 A thickness or lower) of aluminum, stainless 
steel, chromium, or silver, etc., so as to be 
5 sufficiently transmitting for incident light to enable 
proper operation of the photosensor array 32 but also 
sufficiently reflective to appear mirror-like in the 
area of the hole. Alternatively, a reflective tape, 
which is both sufficiently transmitting and reflective 

10 to achieve the objectives described herein, may be 

adhered at the hole region using suitable means such as 
an optical adhesive and the photosensor array 32 may 
then be mounted behind the optical adhesive. 
Additionally, thin film stacks such as a solid state 

15 tri-layer of \ wave Ti0 2 , h wave Si0 2 and % wave Ti0 2 or 
some other single thin film of a high index material 
may be mounted behind or coated upon the area of the 
hole. Finally, since the preferred photosensor array 
32 is responsive to both visible light and near 

20 infrared, it is preferable to select a material which* 
reflects a significant proportion of visible light 
while being essentially transparent to infrared. 

As shown in Figure IB, the photosensor 2 may also be 
25 located in the bezel or chin of the rearview mirror 1 
to view the rearward area directly without any 
compensation. In another preferred embodiment, the 
photosensor 2 may also be located on or near the 
channel mount or mounting bracket lb so that the axis 
30 of the photosensor 2, which is perpendicular to the 
plane of the photosensor array 32, is in fixed 
alignment with the vehicle's center line regardless of 
the adjusted position of the rearview mirror 1. 

35 In particular, as shown in Figures 1C and ID, a sensing 
and logic circuit assembly 27, which comprises a 
sensing and logic circuit 2 6 and the photosensor 2 and 
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switch 3 on a printed circuit board, is located in a 
housing or module 7 that is attached, connected, made 
integral or otherwise associated with the rearview 
mirror 1. In the embodiment shown in Figs. 1C and ID, 
5 a mounting bracket 6 is fixed relative to the headliner 
area of the vehicle body in a header mount arrangement; 
and a rearview mirror head assembly lh is adjusted by a 
spherical pivot 6d at the interface of the mounting 
bracket 6 and the rearview mirror head assembly lh. 

10 The mounting bracket 6 may also be releasably attached 
to a mounting button (not shown) that is attached to 
the windshield to provide generally improved ease of 
assembly and replacement, as well as safety. 
Alternatively, the mounting bracket 6 may be attached 

15 to the windshield or headliner area of the vehicle by 
any of the various means well known to those skilled in 
the art. 

In particular, the mounting bracket 6 comprises a 
20 retaining spring 6a, a retaining screw 6b, a wire 
harness opening 6c for receiving a wire harness 
assembly 8, and a spherical pivot 6d having an opening 
for wires 6e that are used to control the variable 
reflectance mirror element la. The housing or module 7 
25 comprises a retaining housing or module 7a for 
partially mounting the sensing and logic circuit 
assembly 27, a rear housing or module cover 7b, a heat 
sink 7c for the sensing and logic circuit assembly 27, 
a screw 7d for securing the heat sink 7c to the mirror 
3 0 bracket 6, and a wire connector 7e for connecting the 
harness assembly 8 and wires 6e to the sensing and 
control circuit assembly 27. The harness assembly 8 is 
used, in part, to supply power to the sensing and logic 
circuit assembly 27. 

35 

Also, as shown in Figs. 1C and ID, the automatic 
rearview mirror 1 comprises the variable reflectance 
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mirror element la, a mirror cushion support lc, an 
impact absorber layer Id, a bezel le, a mirror case If 
and clamp springs Ig for receiving and securing the 
spherical pivot 6d of the mounting bracket 6. 

5 

For other vehicles, such as trucks, the photosensor 2 
may also be located with each of the external side view 
mirrors as will be described later. 

10 The lens 30 is preferably a single molded plastic lens 
approximately 2 millimeters in diameter and is 
preferably bonded to or in close contact with the 
photosensor array 32. The lens 3 0 may, however, 
include any appropriate image focusing means such as 

15 conventional single component optics, holographic lens 
type optics, binary optics or a microlens. The lens 3 0 
preferably is also designed to focus an image of the 
rearward scene within a field of view defined by a 
cone. The cone's center line is perpendicular to the 

20 plane of the photosensor array 32 and the cone 

preferably has an included angle of approximately 100 
degrees. Thus, the image is focused onto a circular 
area of the plane of the photosensor array 32. Of 
course, the photosensor array 32 could be positioned in 

25 other than a rearwardly facing direction so long as 
appropriate lenses or other optics are used to direct 
the light or image information from the rearward area 
onto the photosensitive surface of the photosensor 
array 32. 

30 

The pre-positioning of the photosensor array 32 in the 
rearview mirror 1 depends on whether the automatic 
rearview mirror system 20 is being used in a left hand 
or a right hand drive vehicle. In either case, the 
35 photosensor array 32 is preferably pre-positioned 

within the circular area of the focused image so that 
for either a left or right hand drive vehicle and with 
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only driver adjustment of the rearview mirror 1, the 
rearward scene imaged onto the photosensitive surface 
of the photosensor array 32 includes the rear window 
area and at least a portion of the left and right side 
5 window areas of the vehicle. 

If a sufficiently large photosensor array 32 is used, 
then the pre-positioning of the photosensor array 32 is 
not vehicle specific as described above, and a system 

10 20 using a larger photosensor array 32 may be used for 
both left and right hand drive vehicles. The larger 
photosensor array 32 is positioned symmetrically within 
the circular area of the focused image described above. 
Using the larger photosensor array 32 involves using a 

15 pattern recognition means to determine the approximate 
vehicle centerline so that the appropriate portion of 
the larger photosensor array 32 may be selected 
depending on whether the automatic rearview mirror 
system 20 is installed in a left or right hand drive 

20 vehicle. 

Figure 2 illustrates an automatic rearview mirror 
system 20 for an automotive vehicle, comprising the 
rearview mirror 1, a left side view mirror 4 and a 

25 right side view mirror 5. As will be discussed below, 
either or both of the side view mirrors 4 and 5 may be 
connected to a control circuit of the rearview mirror 
1. The mirrors 1, 4 and 5 may be constructed according 
to any of the methods known to those skilled in the art 

3 0 and are generally constructed according to the styling 
preferences and specifications of the automotive 
vehicle manufacturers. The means for mounting the 
rearview mirror 1, such as the channel mount lb, and 
the electrical connectors used to connect the mirrors 4 

35 and 5 to the control circuit of the rearview mirror 1 
and the vehicle's electrical system may include any one 
of the many configurations known to those having 
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ordinary skill in the art. The variable reflectance 
mirror element la of the mirrors 1, 4 and 5 may be any 
device having more than one reflectance level 
corresponding to a specific control or drive signal. 
5 Preferably, however, the variable reflectance mirror 
element la is an electrochromic mirror. 

As discussed, the photosensor 2 is mounted facing 
rearwardly of the rearview mirror 1 so that its field 

10 of view encompasses an area comprising the rear window 
area and at least a portion of both the left side 
window area and the right side window area. The 
horizontal and vertical fields of view of the rearward 
area as seen by the photosensor 2 , and more 

15 particularly by the photosensor array 32 , are 
illustratively shown in Figures 3A and 3B. 

As shown in Fig. 3A, the photosensor array 32 senses a 
field of view divided into three separate zones: a 

20 center zone a, a left zone b (generally corresponding 
to the left side window area) and a right zone c 
(generally corresponding to the right side window 
area) . Each zone is sensed by a separate set or 
sub-array S(X) of photosensor elements 32a (described 

25 with respect to Figs. 4A and 4B) within the photosensor 
array 32. The center zone, zone a, generally receives 
light from the rear window area of the vehicle. This 
rear window area is depicted by a trapezoidally shaped 
rear window figure superimposed on a first set or sub- 

30 array S(l) of photosensor elements 32a used to sense 
light levels in zone a. Zone b includes light from at 
least a portion of a left side window area. This is 
depicted by a trapezoidally shaped left rear side 
window figure and a partially shown left front side 

35 window figure superimposed on a second set or sub-array 
S(2) of photosensor elements 32a used to sense light 
levels in zone b. Similarly, zone c includes light 
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from at least a portion of a right side window area. 
This is depicted by a trapezoidally shaped right rear 
side window figure and a partially shown right front 
side window figure superimposed on a third set or sub- 
5 array S(3) of photosensor elements 32a used to sense 
light levels in zone c. Additionally, all three zones 
include light reflected from whatever fixed body work 
and interior trim, head rests, vehicle occupants or 
other objects that are within the zones a, b and c. 

10 

Also as illustratively shown in Fig. 3A, the 
photosensor elements 32a in columns 1 to 4 comprise the 
third photosensor element set in zone c, the 
photosensor elements 32a in columns 6-11 comprise the 

15 first photosensor element set in zone a and the 

photosensor elements 32a in columns 13 to 16 comprise 
the second photosensor element set in zone b. Null 
zones are provided between the zones a and b and 
between the zones a and c to allow for driver 

20 adjustment of the rearview mirror 1, These null zones 
also ensure that the center zone a does not include 
light or other image information from the side window 
areas of zones b and c. 

25 As will be discussed in more detail below, the logic 
and control circuit 34 selects photosensor element 
signals from the first photosensor element set or sub- 
array S(l) (shown in Fig. 4B) corresponding to zone a 
to control the reflectance level of the rearview mirror 

3 0 1. Similarly, the control circuit 34 selects 

photosensor element signals from the second photosensor 
element set or sub-array S(2) (shown in Fig. 4B) 
corresponding to zone b to control the reflectance 
level of the left side view mirror 4, and further 

35 selects photosensor element signals from the third 
photosensor element set or sub-array S(3) (shown in 
Fig. 4B) corresponding to zone c to control the 
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reflectance level of the right side view mirror 5. 
Additionally, for a variable reflectance mirror element 
la having segments, such as a center, left and right 
segment, appropriately defined zones a, b and c, i.e., 
5 sub-arrays S(l), S(2) and S(3), corresponding to the 
mirror segments may be used by the logic and control 
circuit 34 to control independently the individual 
mirror segments. 

10 Figure 3B illustratively shows the preferred embodiment 
for the zones of the photosensor array 32. In this 
embodiment, the logic and control circuit 34 selects 
photosensor element signals from three overlapping sets 
or sub-arrays S(l), S(2) and S(3) of photosensor 

15 elements 32a corresponding to the three overlapping 
zones a, b and c to control, respectively, the 
reflectance level of the mirrors 1, 4 and 5. More 
specifically, the control circuit 34 selects 
photosensor element signals from the photosensor 

20 elements 32a in columns 6 to 11 (zone a) to control the 
reflectance level of the rearview mirror 1. The 
control circuit 34 also selects photosensor element 
signals from photosensor elements 32a in columns 10 to 
14 (zone b) to control the reflectance level of the 

25 left side view mirror 4, and further selects 

photosensor element signals from photosensor elements 
32a in columns 3 to 7 (zone c) to control the 
reflectance level of the right side view mirror 5. 

3 0 Additionally, in the Fig. 3B embodiment, the lens 3 0 

focuses or images light information from: (1) the rear 
window area onto zone a; (2) at least a portion of the 
rear window and left side window areas onto zone b; and 
(3) at least a portion of the rear window and right 

35 side window areas onto zone c. Contrastingly, in the 
Fig. 3A embodiment, the lens 30 focuses light from: 
(1) the rear window area onto zone a; (2) the left side 
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window area onto zone b; and (3) the right side window 
area onto zone c. The overlapping zones in the Fig. 3B 
embodiment are advantageous because each set of 
overlapping photosensor elements 32a in zones a and b 
5 and each set of overlapping photosensor elements 32a in 
zones a and c, as well as the logic and control circuit 
34, is able to "preview" the light information that 
may, for example, first appear in the rear window area 
(and correspondingly in the rearview mirror 1) , but 

10 which may appear shortly thereafter in the left or 

right side view mirrors 4 and 5. By examining at least 
a portion of the rear window area, the automatic 
rearview mirror system 20 is able to more quickly 
respond to annoying glare light from approaching 

15 vehicles or other sources. Overlapping zones are also 
generally preferred because a glare light source 
located in a common or overlapping area of the rearview 
mirror 1 and one of the side view mirrors 4 or 5 can 
influence both mirrors. 

20 

11 • The Licrht Sensing Device 

The light sensing device of the light sensing and logic 
circuit 26 is preferably the photosensor array 32 shown 

25 in Fig. 5. The photosensor array 32 has sufficient 
resolution to view the real image of a scene but may 
also use a spatial distribution of light intensities as 
an approximation of the imaged scene. An example of 
such a photosensor array 32 is the VLSI Vision Limited 

30 (WL) Single Chip Video Camera Model #ASIS 1011. 

Since a photosensor array 32 of the type described, 
namely the WL Single Chip Video Camera, is capable of 
providing image information having sufficient 
35 resolution for displaying an actual image or for some 
other purpose, it will be readily understood that 
additional features or functions may be incorporated by 
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adding circuitry to provide video output from the 
photosensor array 32 in addition to the primary control 
functions described herein. For example, the video 
output may be output to a CRT, flat LC panel display or 
5 other appropriate display device, located within the 
vehicle, to provide a display of the imaged scene for 
viewing by the driver. 

The photosensor array 32 may be located in any of the 
10 mirrors 28 or in any other appropriate location, 

whether local or remote, such as on the vehicle's rear 
bumper, thereby extending significantly the effective 
field of view normally available to the driver either 
directly or through the vehicle's mirrors 28. 
15 Additionally, the photosensor array 3 2 may even replace 
one or more of the side view mirrors 4 and 5 of the 
automatic rearview mirror system 20, thereby reducing 
the aerodynamic drag on the vehicle while providing 
sufficient information to the driver comparable to that 

2 0 available through the side view mirrors 4 and 5. 

A video signal from the photosensor array 32 may also 
be used by the logic and control circuit 34 to 
determine the presence of a vehicle or other object 
25 within the field of view of the photosensor array 3 2 to 
provide a visual signal warning such as through a 
display panel, or even an audible warning, based on 
certain parameters, such as distance and speed of the 
object. Additionally, if the photosensor array 32 is 

3 0 located in the rearview mirror 1, the video signal may 

be used to monitor the vehicle's interior to detect 
unauthorized intrusion into the vehicle. This may be 
achieved by providing electrical power to the mirror's 
logic and control circuit 34 from a vehicle power 
35 supply and by activating a vehicle intrusion monitoring 
mode when a signal indicates that the vehicle's door 
and trunk locks have been activated. The logic and 



- 30 - 



control circuit 34 may be used to continuously monitor 
the image from the vehicle's interior thereby allowing 
detection of objects or persons moving within the 
vehicle, and if movement is detected, another signal 
5 from the logic and control circuit 34 may then activate 
an intrusion alarm. 

Thus, the photosensor array 32 may be used to monitor 
the vehicle interior or compartment in a vehicle 

10 interior monitoring system- This monitoring capability 
may be used in a vehicle intrusion detection system or 
in a compartment image data storage system, either in 
combination with the automatic rearview mirror system 
or as an independent system. Using the photosensor 

15 array 32 to monitor the vehicle interior to detect 
potential intruders provides an effective vehicle 
intrusion detection system. In an automatic rearview 
mirror and vehicle intrusion detection system, the 
photosensor array 32 in the rearview mirror 1 provides 

20 a good location for monitoring the vehicle interior 

because the rearview mirror 1 is: (1) centrally located 
along the vehicle axis; (2) forward of the front seat; 
and (3) relatively high in the vehicle interior. This 
location is sufficiently high and far forward so as to 

25 provide a very good view of the vehicle interior, 

including the front and rear seat areas, front and rear 
door areas and hatchback or rear cargo door areas. The 
photosensor array 32 may also be positioned in other 
locations, including the headliner and headliner 

30 console areas, for example, or any other appropriate 
location depending on the particular application. 

As is discussed later, when the vehicle interior 
monitoring system is used as a vehicle intrusion 
35 detection system, the logic and control circuit 34 
processes image data to detect motion or movement in 
the vehicle interior, establishes an intrusion 
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condition if such motion is detected and outputs one or 
more control signals to vehicle hardware or to a 
vehicle controller system . Vehicles today are often 
equipped with such controller systems. These vehicle 
5 controller systems may be used to control the exterior 
lights, interior lights, horn (or siren), ignition or 
other such vehicle hardware. The logic and control 
circuit 34 therefore outputs one or more control 
signals to various vehicle hardware or to the vehicle 

10 controller system to activate the interior and exterior 
lights, horn or siren or to disable the ignition to 
deter intruders from stealing the vehicle or its 
contents. Other control output signals may activate RF 
beacon devices or similar devices within the vehicle so 

15 that the vehicle may be tracked, as will be further 
described later. 

It is, however, within the scope of the present 
invention for the light sensing device to comprise any 
similarly appropriate image or array sensor. When the 
light sensing and logic circuit 26 is formed as a very- 
large-scale-integrated (VLSI) complementary-metal- 
oxide-semiconductor (CMOS) device, as is known to those 
skilled in the art, the light sensing device will share 
a common semiconductor substrate with the logic and 
control circuit 34. 

Preferably, for the described three mirror system, the 
photosensor array 32 comprises a plurality of 
30 photosensor elements 32a arranged in 160 columns and 40 
rows (a 160 x 40 array) providing a horizontal field of 
view of approximately 100 degrees and a vertical field 
of view of approximately 30 degrees. As discussed, 
Figs. 3A and 3B illustratively show a 16 x 4 
35 photosensor array 32. The photosensor array 3 2 may, 
however, comprise any appropriately sized array having 
an appropriate field of view. For example, the field 
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of view may be narrower when controlling the segments 
of only one mirror. Each photosensor element 32a is 
preferably about 10 microns square. 

5 As shown in Figure 4A, the photosensor array 32 

generally comprises a plurality of photosensor elements 
32a arranged in a photosensor array PA(N,M) having N 
rows of M columns. When viewing the photosensitive 
surface of the photosensor array PA(N,M) in a vertical 

10 plane, the lower row is row 1, the top row is row N, 
the left hand column is column 1, and the right hand 
column is column M. A specific photosensor element is 
identified as E(n,m) and the signal indicative of a 
light level incident thereon is L(n,m) . Also, the sub- 

15 array S(X), where X = 0, 1, 2 , . . . , Z, is a 

rectangular array having P(X) rows of Q(X) columns of 
photosensor elements 32a and is located such that its 
lower left hand element is photosensor element 
E(T(X) ,U(X)) . 

20 

As shown in Figure 4B, a background sub-array S(X) 
designated S(0) is used to determine a general 
background light level B. Signals from the photosensor 
elements 32a of each peak sub-array S(X), designated 

25 S(l), S(2), . . ., S(Z), are used to determine a peak 
light level P(z) incident on each peak sub-array S(l), 
S(2), . . S(Z). The general background light level 
B for background sub-array S(0) and the peak light 
level P(z) for each peak sub-array S(X) are then used 

3 0 to determine a mirror control signal V c (z) for 

controlling at least one mirror or mirror segments 
associated with each zone. 

Figure 5 generally illustrates a logic layout of the 
35 photosensor array 32. The logic and control circuit 34 
generates array control signals to control the 
photosensor array 32. As is well known in the art, the 
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photosensor array 32 is typically accessed in scan-line 
format, with the array 32 being read as consecutive 
rows, and within each row as consecutive columns or 
pixels. Each photosensor element 32a is connected to a 
5 common word-line 33e. To access the photosensor array 
32, a vertical shift register 33a generates word-line 
signals for each word-line 3 3e to enable each row of 
photosensor elements 32a. Each column of photosensor 
elements 32a is connected to a bit-line 33f which is 

10 connected to a charge- to- volt age amplifier 3 3c. As 
each word-line 33e is accessed, a horizontal shift 
register 33b uses a line 3 3g to output the bit-line 
signals on consecutive bit-lines 3 3f to an output line 
33h connected to the logic and control circuit 34. 

15 Also shown is a voltage amplifier 3 3d used to amplify 
the resulting analog photosensor element signals. The 
analog photosensor element signals are then output on 
line 33h to the analog-to-digital converter 44 and 
converted to digital photosensor element signals. 

20 

As discussed above, the photosensor array 3 2 is 
responsive to or senses both visible light and near 
infrared illumination. Figures 11A and 11B illustrate 
the normalized spectral response for two versions of 

25 the preferred photosensor array 32. In Figs. 11A and 
11B, visible light generally covers the wavelengths 
from about 400 nm to about 750 nm, while near infrared 
illumination or light generally covers the wavelengths 
from about 750 nm to about 3000 nm (not shown) . More 

30 particularly, Fig. 11A illustrates the normalized 

spectral response of the preferred photosensor array 32 
made using a non-epitaxial silicon process, where the 
peak spectral response occurs at about 8 00 nm. Figure 
11B shows the normalized spectral response of the 

35 preferred photosensor array 32 made using an epitaxial 
silicon process, where the peak spectral response 
occurs at about 650 nm. As shown, the non-epitaxial 



silicon photosensor array is more sensitive to near 
infrared illumination having wavelengths on the order 
of about 800nm. The photosensor array 32 made using 
the non-epitaxial silicon process and having the 
normalized spectral response of Fig. 11A is most 
preferred in both the particular automatic rearview 
mirror and vehicle interior monitoring systems 
described herein. For automatic rearview mirror 
systems as described herein, this is because vehicle 
headlights generally provide significant levels of near 
infrared illumination. For vehicle interior monitoring 
systems as described herein, either natural sources 
(such as sunlight) or supplemental sources of near 
infrared illumination may be used to enhance the image 
information available to and the performance of such 
systems, as will be further discussed below. 

The field of view and resolution of the photosensor 
array 32 depends on the number and physical dimensions 
of the photosensor elements 32a and on the design or 
geometry of the lens 30. For the lens type illustrated 
in Fig. 1A, the lens 3 0 may, for example, be designed 
to have an included angle on the order of up to about 
140°. For the automatic rearview mirror system 
previously described, the effective field of view of 
approximately 100° horizontal and approximately 30° 
vertical is preferred. For the automatic rearview 
mirror and vehicle interior monitoring system described 
herein, an effective field of view of approximately 
100° horizontal and approximately 75° vertical is 
preferred. Also as discussed for the automatic 
rearview mirror system, the lens 30 preferably focuses 
an image within a field of view defined by a cone 
having an included angle of approximately 100 degrees. 
Accordingly, when the lens 3 0 focuses the image onto 
the focal plane of the 160 x 40 photosensor array 32, 
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the photosensor array 32 only falls within a segment of 
the focused image area. 

Figure 2A generally illustrates a view of a vehicle 
5 interior 100 (which includes the window areas of Figs. 
3A and 3B) as focused by the lens 3 0 and as viewed by a 
160 x 120 photosensor array 32. Also shown are a 
driver or left seat 101, a front passenger or right 
seat 102, a rear window area 103a, a right side window 

10 area 103b and a left side window area 103c. The 160 x 
40 photosensor array 32, however, only sees a portion 
or segment of the vehicle interior 100, as is shown in 
Figs. 3 A and 3B. In a dedicated automatic rearview 
mirror system, the 160 x 40 sized array is generally 

15 preferred since it provides sufficient image 

information for providing effective automatic rearview 
mirror control and because it reduces the cost of the 
photosensor array 32. If the photosensor array 32 is 
also used to monitor the vehicle interior 100 (or for 

2 0 other applications) as is described herein, then the 

larger 160 x 12 0 array size may be used to view the 
vehicle interior 100 as is generally illustrated in 
Fig. 2A. 

25 Finally, it should be understood that the spatial 
resolution of the photosensor array 32 may also be 
increased. This may be done by making the photosensor 
elements 32a smaller so as to increase the number of 
photosensor elements 32a in a photosensor array 32 

3 0 having the same physical dimensions. Additionally, 

spatial resolution may be increased by varying the lens 
30 to decrease the included angle of the image cone so 
that the photosensor array 32 views a smaller portion 
of an image on the vehicle interior 100. 

35 

In summary, the array size of the photosensor array 32 
and the number and physical dimensions of the size of 
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the photosensor elements 32a and the lens design or 
geometry of lens 30 may all be varied to optimize the 
effective field of view of the photosensor array 32 
depending on the application. 

5 

As is discussed later, an exposure time or exposure 
period EP of the photosensor array 3 2 may be varied 
over some range depending on the light level. Thus, 
the value of EP is increased for decreasing light 

10 levels and approaches a maximum for low light levels, 
and it is decreased for increasing light levels and 
approaches a minimum for high light levels. For a 
given value EP V of the exposure period, there is a 
light level LL^ that is sufficiently distinct from low 

15 signal noise in the photosensor element signal L(n,m) 
of each photosensor element E(n,m) so that it may be 
accurately sensed, and there is also a light level LL,^ 
for which the photosensor element signal L(n,m) of each 
photosensor element E(n,m) is a maximum. The ratio of 

2 0 LLmax/LLkon at EP V may be used to represent a dynamic 
range of DR(n,m) in decibel (dB) units of each 
photosensor element E(n,m) , where DR(dB) = 
10 LOG (LLmax/LL^) . The image data is preferably 
optimized such that it is approximately centered within 

25 the dynamic range DR(N,M) of the photosensor array 32. 
This may be done by determining an array response AR of 
RA(N,M), which is described later, where the minimum 
and maximum digital values of AR correspond to the 
minimum and maximum digital values possible for Val 

30 RA(n,m) (e.g., 0 and 255 for 8-bit data resolution). 
The exposure period is varied or adjusted until AR 
approaches the center or mid-point of the possible data 
value range (e.g., 127 for 8-bit data resolution). 

35 Since there is a minimum photosensor element signal 

that may be accurately measured, a supplemental source 
of illumination may be desirable or necessary to 
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enhance the effective sensing capabilities of the 
photosensor array 32 by providing supplemental source 
illumination SSI. Although the photosensor array 32 is 
able to monitor the vehicle interior 100 over a range 
5 of background lighting levels from about 0.1 lux (a 

dark garage) to about 30-60K lux (a bright, sunny day) , 
using either visible or near infrared SSI to illuminate 
the vehicle interior 100 generally (or specific areas 
therein) significantly enhances the effectiveness or 

10 performance of the photosensor array 32 in various 
applications. Also, SSI is preferably provided only 
during the exposure period EP of the photosensor array 
32 rather than continuously. Pulsed SSI reduces power 
consumption, extends the life of the supplemental 

15 source of illumination and provides generally higher 
instantaneous illumination than may be provided by 
continuous illumination. Also, pulsed infrared SSI is 
generally more difficult to detect by infrared 
illumination sensing apparatus that may be used by 

20 potential intruders. 

For the specific vehicle interior monitoring system 
applications described herein, near infrared 
illumination between about 700 and 1200 nm is preferred 

25 because: (1) it is visible to the photosensor array 32 
but not to the human eye (see Figs. 11A and 11B) ; and 
(2) it does not affect adaption of the human eye. 
There are a number of readily available near infrared 
illumination sources, including solid-state sources 

30 such as light emitting diodes (LEDs) and lasers, flash 
lamps such as xenon or krypton lamps, incandescent 
lamps such as tungsten lamps, as well as many others. 
Preferred, however, are gallium arsenide (GaAs) or 
gallium aluminum arsenide (GaAlAs) LEDs because they 

35 provide a relatively narrow band (about 750 to 950 nm) 
of near infrared illumination (see Figs. 11A and 11B) . 
Such illumination sources are also typically packaged 



with a lens to distribute the illumination. Depending 
on the particular application, the illumination 
distribution characteristics of readily available 
lens/ source packages may range from narrow so as to 
5 provide spot or collimated illumination to very diffuse 
so as to cover about 160° . In the vehicle interior 
monitoring system described herein, the lens /source 
package preferably provides illumination coverage on 
the order of about 100°. 

10 

Other illumination sources providing broad-band 
illumination (ultraviolet through infrared) may also be 
used, but it may be desirable or necessary to filter 
such broad-band illumination using absorption or 

15 interference type filters, or any other appropriate 

filter. In particular, an interference filter known as 
a long-wave pass filter or cold mirror reflects visible 
light, transmits infrared illumination and looks like 
the normal silvered mirrors typically used in the 

20 rearview mirror 1. Unlike cold mirrors, however, 

silvered mirrors reflect near infrared illumination. 
Since the cold mirror resembles the silvered mirror in 
the rearview mirror 1, it may be used to replace a 
section or even all of the silvered mirror. In 

25 particular, the supplemental source of illumination may 
be located behind the cold mirror element and adjacent 
to the photosensor array 32 with an opaque barrier 
separating the two to prevent supplemental illumination 
reflections within the rearview mirror 1 from directly 

30 affecting the photosensor array 32. 

Alternatively, a long-wave pass absorption filter may 
be used with a supplemental source of broad-band 
infrared illumination. Long-wave pass absorption 
35 filters may be fabricated using a wide variety of 
polymers having appropriate optical transmission 
characteristics such as epoxies, acrylics, 
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polycarbonates, as well as a variety of glasses. The 
acrylic and polycarbonate polymers are preferred 
because they are environmentally stable, cost effective 
and because they may be used to injection mold parts 
5 having various geometric shapes or polished or textured 
surfaces. Using absorption filter materials, the 
photosensor array 32 and supplemental source of 
illumination may be integrated into the rearview mirror 
1 or elsewhere within or on the vehicle so that they 
10 are not readily apparent to vehicle occupants, passers- 
by or potential intruders. 

III. The Logic And Control Circuit 

15 Figure 6 shows the light sensing and logic circuit 26 
comprising the photosensor array 32 and the logic and 
control circuit 34. The logic and control circuit 34 
comprises a logic circuit 46, a clock 47, a random- 
access-memory (RAM) 50, or other appropriate memory, 

20 and a digital-to-analog converter 52. The logic 

circuit 46 is preferably a dedicated configuration of 
digital logic elements constructed on the same 
semiconductor substrate as the photosensor array 32. 
Alternatively, the logic circuit 46 may also be a 

25 microprocessor comprising a central processing unit 

(CPU) and a read-only-memory (ROM) . The logic circuit 
46 may also be implemented using gate array technology 
or any other appropriate hardwired logic circuit 
technology. 

30 

The logic circuit 46 interfaces with the clock 47, 
provides array control signals to the photosensor array 
32, manages data flow to and from the RAM 50 and 
converters 44 and 52, and performs all computations for 
35 determining a digital mirror control signal V DAC (Z) for 
causing the variable reflectance mirror element la to 
assume a desired reflectance level. As discussed, the 
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analog-to-digital converter 44 converts the analog 
photosensor element signals to the digital photosensor 
element signals processed by the logic circuit 46. It 
has been found that an eight-bit analog-to-digital 
5 converter 44 provides adequate data resolution for 
controlling the mirrors 1, 4 and 5. Preferably, the 
analog-to-digital converter 44 is constructed on the 
same semiconductor substrate as the photosensor array 
32 as shown in Fig. 5. 

10 

The digital photosensor element signals output to the 
logic and control circuit 34 are generally stored in 
the RAM 50 for processing. The values of the digital 
photosensor element signals for the photosensor array 
15 PA(N,M) are correspondingly stored in an array in the 
RAM 50 designated RA(N,M) . The logic circuit 4 6 
processes the values of each of the digital photosensor 
element signals, which are designated Val RA(n,m) , to 
determine an instantaneous or substantially real-time 

2 0 background light signal B t for a time period t and at 

least one peak light signal P(z) . The logic circuit 46 
uses these signals, which may also be temporarily 
stored in the RAM 50, to determine a digital control 
signal V DAC (z) to cause at least one mirror or mirror 
25 segment to assume a desired reflectance level. The 

digital mirror control signal V DAC (z) is then output to 
the digital-to-analog converter 52, which outputs a 
corresponding analog mirror control signal V c (z) to a 
mirror drive circuit 24. Alternatively, the digital- 

3 0 to-analog converter 52 need not be used if the logic 

circuit 46 generates a pulse-width-modulated (PWM) 
mirror control signal to control the mirror drive 
circuit 24. 

35 The mirror drive circuit 24 comprises mirror drive 

circuits 24a, 2-4b and 24c. The drive circuit 24 drives 
mirrors 28, which comprises a rearview mirror 28a 
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(mirror A) , a left side view mirror 28b (mirror B) and 
a right side view mirror 28c (mirror C) . Mirrors A, B 
and C correspond, respectively, to the rearview mirror 
1, the left side view mirror 4 and the right side view 
5 mirror 5 shown in Fig. 2. It is, of course, within the 
scope of the present invention for the mirror A to be a 
mirror other than the rearview mirror 1. It is 
similarly within the scope of the present invention for 
the mirror B to be a mirror other than the left side 

10 view mirror 4, and for the mirror C to be a mirror 
other than the right side view mirror 5- It is also 
within the scope of the invention for the mirrors A, B 
and C to be mirror segments or zones of the variable 
reflectance mirror element la where the peak sub-array 

15 S(X) for each zone corresponds to a segment of the 
variable reflectance mirror element la. Thus, for 
example, S(l) may correspond to a center mirror 
segment, S(2) may correspond to a left mirror segment 
and S(3) may correspond to a right mirror segment. Any 

2 0 other appropriate mirror segmentation scheme may also 
be used. 

A sensitivity control circuit 42 is used to input a 
sensitivity signal S to the logic and control circuit 

25 34. In addition, signals from a force-to-day (maximum 
reflectance) switch 36, a reverse-inhibit (maximum 
reflectance) switch 38 and a force-to-night (minimum 
reflectance) switch 4 0 may also be input to the logic 
and control circuit 34. The switch 3 of Figs. 1A and 

30 IB may include the sensitivity control circuit 42, as 
well as the force-to-day switch 3 6 and the force- to- 
night switch 40. 

The switches 36, 38 and 40 each generate a signal 
35 causing the logic circuit 4 6 to override its normal 
operation, as will be described with respect to Figs. 
7, 8A and 8B, and to output mirror control signals V c (z) 
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to the mirror drive circuit 24 causing the variable 
reflectance mirror 28 to assume a maximum or minimum 
reflectance level in accordance with the appropriate 
signals from the switches 36, 38 or 40. 

5 

Finally, the logic and control circuit 34 may also be 
used to control a vehicle lighting switch 45 to 
automatically turn on and off a vehicle's headlights 
and sidelights. This feature will be further described 
10 later. 

Figure 6A shows the block schematic diagram of the 
automatic rearview mirror and vehicle interior 
monitoring system. The previous description of Figure 
15 6 applies here except as follows. First, the logic and 
control circuit 34 includes an analog-to-digital 
converter 55 for converting one or more analog control 
input signals 70 (1, 2, . . . , N; blocks 70a to 70n) to 
digital signals that are input to the logic circuit 46. 

20 

With respect to the automatic rearview mirror system, 
the analog control input signals 70 may include any 
analog control input signal used therein, including, 
for example, analog versions of the control input 

25 signals provided by the force-to-day-switch 36, 

reverse-inhibit-switch 38, force-to-night-switch 40 or 
sensitivity control circuit 42 of Fig. 6. Of course, 
digital versions of these same control input signals 
may also be input to the logic circuit 46 as digital 

30 control input signals 75 (1, 2, . . ., N; blocks 75a to 
75n) . The analog control output signals 80 (1, 2, . . 
., N; blocks 80a to 80n) may include any analog control 
output signal used in the automatic rearview mirror 
system, including the analog mirror control signals 

35 V c (z). The analog circuits/ switches 81 (1, 2, . . ., N; 
blocks 81a to 8 In) may include the drive mirror 
circuits 24 that are used to drive the variable 
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reflectance mirrors 28. As discussed with respect to 
Fig- 6, the analog mirror control signal V c (z) is output 
to the mirror drive circuit 24 causing the variable 
reflectance mirror 28 to change reflectance levels. Of 
5 course, digital control output signals 85 (1, 2, . . . , 
N; blocks 85a to 85n) may also be output to digital 
circuits/ switches 86 (1, 2, . . ., N; blocks 86a to 
86n) to the extent that the control output signals are 
digital and not analog. 

10 

With respect to the vehicle interior monitoring system 
configured as a vehicle intrusion detection system, 
analog control input signals 70 and digital control 
input signals 75 may include, respectively, analog and 

15 digital versions of control input signals used to "arm" 
or "alert" the vehicle intrusion detection system, as 
will be further described later. The analog control 
output signals 80 may include any analog control 
signals output to analog circuits /switches 81 that are 

2 0 used in the above system, including analog circuits or 
switches used to actuate various vehicle hardware, such 
as the vehicle horn (or siren) , exterior and interior 
lights or ignition control devices. Of course, digital 
control output signals 85 (1, 2, . . ., N; blocks 85a 

25 to 85n) may also be output to digital circuits/ switches 
86 (1, 2, . . N; blocks 86a to 86n) to the extent 
that the control output signals are digital and not 
analog. In particular, the digital control output 
signal 85 may include a digital word provided to a 

30 digital circuit/ switch 86 that is a vehicle controller 
system that interfaces with such vehicle hardware. 

When the vehicle interior monitoring system is 
configured as a compartment image data storage system, 
35 a nonvolatile memory 57, as shown in Fig. 6A, is 

included. The nonvolatile memory 57 interfaces with 
the logic circuit 46. The nonvolatile memory 57 is 
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used to store image data, as will be further described 
later. The nonvolatile memory 57 may be an EEPROM or 
other appropriate nonvolatile memory. An 
access /security decoding logic circuit 58 interfaces 
5 with a data access port 59 and the logic circuit 46. 
The access/ security decoding logic circuit 58 and data 
access port 59 are used to access the image data stored 
in the nonvolatile memory 57, as will be further 
described later. Optionally, this system may include a 
10 data compression logic circuit 56 for compressing image 
data received from the logic circuit 46 before it is 
stored in the nonvolatile memory 57. The data 
compression logic circuit 56 may be integral with the 
logic circuit 46. 

15 

Finally, whether configured as a vehicle intrusion 
detection system or as a compartment image data storage 
system, the vehicle interior monitoring system 
preferably includes a supplemental source of 

20 illumination 61 having a lens 62 as shown in Fig. 6A. 
A supplemental source of illumination drive circuit 60 
is connected to the supplemental source of illumination 
61. The drive circuit 60 also interfaces with and 
receives control signals from the logic circuit 46 to 

25 drive the supplemental source of illumination 61. 

IV. Operation Of The Invention 

Figure 7 shows an overview of the logic flow chart and 
3 0 method for controlling the reflectance levels of any 
one or all of the mirrors or mirror segments 28a, 28b 
or 28c. It should be understood that the reflectance 
level of each of the mirrors 28a, 28b and 28c in the 
automatic rearview mirror system of the present 
35 invention may be commonly or independently controlled. 
Figures 8A, 8B and 9 provide more detail on the logic 
and method of Fig. 7. 
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In step S101 of Fig- 7, light information seen 
rearwardly of the rearview mirror 1 is incident on the 
lens 30. In step S110, light passing through the lens 
30 is refracted such that the light information is 
imaged or focused onto the photosensitive surface of 
the photosensor array 32. In step S120, the logic 
circuit 46 generates and outputs the array control 
signals to the photosensor array 32. In step S130, 
photosensor element signals indicative of the light 
levels incident on each of the photosensor elements 32a 
are generated. In step S14 0, these photosensor element 
signals are temporarily stored in RAM or any other 
appropriate memory. In steps S150 and S160, the logic 
circuit 46 determines values for the background light 
signal and the peak light signal for each zone 
corresponding to each of the mirrors 28. In step S180, 
the logic circuit 46 uses the background and peak light 
signals of step S150 to determine the control signals 
required to cause each of the mirrors 28 to achieve a 
desired reflectance level. Also, the logic and control 
circuit 34 in step S180 reads and processes the states 
of the optional sensitivity control circuit 42, force- 
to-day switch 36, force-to-night switch 4 0 and reverse- 
inhibit switch 38. In step S200, the mirror drive 
circuits 24 use the control signals determined in step 
S180 to generate drive signals to cause the mirrors 28 
to assume the desired reflectance levels in step S210. 

In one embodiment of the invention, the logic circuit 
46 determines the background light signal B t in steps 
S150 and S160 by calculating the average value of the 
photosensor element signals, previously stored in RAM 
in step S14 0, for the photosensor elements 32a in a 
lowest row or rows of the photosensor array 32 
corresponding to an area below the rear window. With 
respect to Figs. 3A and 3B, this means that the 
background light signal B t is determined from 
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photosensor element signals generated by the 
photosensor elements 32a located in row D of the 
photosensor matrix array 32. The logic circuit 46 may 
then output B t to the RAM 50 for later processing. The 
5 logic circuit 46 may also determine B t by calculating an 
average value of all of the photosensor element signals 
in the entire photosensor array 32. More generally, 
the background light signal B t for the rearward scene 
may be determined by calculating the average value of X 

10 percent of the lowest photosensor element signal values 
in the RAM array RA(N,M) , where X is preferably 75, but 
typically may be in the range of 5 to 100. 
Alternatively, an exposure period EP, as is described 
herein, may be used to determine the background light 

15 signal B t . An array response AR may be determined using 
an array average method, as is also described herein, 
for the photosensor element signal values corresponding 
to a sub-array S(X) of the photosensor elements 32a of 
the photosensor array 32 that correspond to an area 

20 below the rear window. The exposure period EP may be 
varied within an operating point range OP ± R, where OP 
is 10 and R is 5 (8-bit data), but where OP may be from 
5 to 175 and R may be from 2 to 15. The exposure 
period is varied to maintain AR within OP ± R. The 

25 background light signal B t may therefore be determined 
where B t varies inversely with EP. 

Additionally, the background light signal B t is 
preferably change- limited to determine a limited 

30 background light signal B u . The signal B t may be 

change- limited, for example, by limiting changes in the 
background light signal B t to 2% per time frame. A time 
frame may be, for example, 2 50 milliseconds or any 
other time relating to the rate at which the logic 

35 circuit 46 samples the photosensor element signals from 
the photosensor array 32. The logic circuit 46 
determines the change-limited value B Lt used to 
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determine the digital mirror control signal V DAC (z) as 
follows: B u = B W) + C L x (B t - B W) ) , where B u = the 
change- limited background light signal for a current 
time frame t, B t = the actual or substantially real-time 
5 background light signal for the current time frame t, 
B ut -i) = the change- limited background light signal for a 
previous time frame (t-1) and C L = the change-limit 
value. Additionally, the background light signal B t 
from step S150 may be processed by the logic circuit 46 

10 to determine whether the change limited background 

light signal B u is less than or greater than B L(M) . If 
B u is greater than B L(M) , then the logic circuit 46 may 
use a higher change- limit value C LH to determine B u . If 
the background light signal B u is less than or equal to 

15 B W) , then the logic circuit 46 may use a lower change- 
limit value Cll to determine B u . The values Clh and C LL 
are in the range of 0-01 to 2, but are preferably on 
the order of about 0.02 or 2%. 

20 The logic circuit 46 in step S150 also determines the 
peak light signal P(z) for each zone or sub-array S(X) 
of the photosensor matrix array 32. The peak light 
signal P(z) used to determine the appropriate mirror 
control signal V c (z) for the mirror 28 may be determined 

25 by counting or summing the number of occurrences where 
the digital value for a photosensor element signal is 
greater than a peak threshold value F for each zone or 
sub-array S(X). For the preferred analog-to-digital 
converter having eight-bit data resolution, the logic 

3 0 circuit 46 generates digital values indicative of light 
levels of light incident on each photosensor element 
32a in the range of 0 to 255 (2 8 - 1 = 255) , with 
headlights resulting in values in the range of about 
200 to 255, so that the peak threshold value F is 

35 selected to be in the range of about 200 to 255 but is 
preferably 245. The resulting count or sum P(z) 
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provides a measure of the peak light level for the 
following reasons. 

One design objective of the lens 30 and the photosensor 
5 array 32 combination is to be able to measure 

background light levels in the approximate range of 
0.01 to 0.1 lux when driving on sufficiently dark 
roads. This is achieved by ensuring that the lens 30, 
photosensor elements 32a and charge- to- volt age 

10 amplifiers 33c are able to measure such light levels 
and by providing a maximum exposure time. The maximum 
exposure time determines the operating frequency or 
sampling rate of the system 20. In the case of the 
described system, 1.5 MHz has been found to be 

15 appropriate. 

By varying the exposure time relative to a general 
background light level B and using a substantially 
constant sampling rate, a wide range of background 

20 light levels in the range of 0.01 to 1000 lux can be 
measured. Thus, when the background light level is 
low, the exposure time is relatively long such that 
headlights within the rearward area cause the affected 
photosensor elements 32a to saturate. Correspondingly, 

25 for higher background light levels, the exposure time 
is reduced. Saturation occurs when the incident light 
charges the photosensor element 32a to capacity so that 
any excess charge will leak or transfer to adjacent 
photosensor elements 32a. This charge leakage effect 

30 is commonly referred to as "blooming." It has been 
found that a count of the number of photosensor 
elements 32a at or near saturation, i.e., those having 
digital values greater than the peak threshold value F, 
provides an excellent approximation of the peak light 

35 levels and is further described in Fig. 8A. The above 
described method effectively extends the range of 
measurable light levels for the photosensor array 32. 
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As discussed, photosensor element signals are 
indicative of the incident light level or intensity and 
the time period for which they are exposed to such 
light. By operating the photosensor array 32 for a 

5 known exposure time or exposure period EP, the incident 
light intensity may be determined from the photosensor 
element signal generated by each photosensor element 
32a. After the exposure period, the logic and control 
circuit 34 processes all of the photosensor element 

10 signals for each photosensor element 32a of the 

photosensor array 32. This signal processing at least 
includes the process of storing the digital value of 
each photosensor element signal to obtain RA(N,M) , but 
normally includes all other processing for each image 

15 data set RA(N,M) up to and including the generation of 
output control signals, such as the mirror control 
signal V C (Z) . The time from the beginning of the 
exposure period EP through the processing of each image 
data set RA(N,M) and the generation of the appropriate 

20 output control signals is referred to as the operating 
or sampling period, and the frequency thereof is 
referred to as the operating frequency or sampling 
rate. The frequency at which the process is repeated 
may also be referred to as the frame rate or the image 

25 sampling frequency. The rate of each sub-process 

(e.g. , exposure period) within the sampling period is 
controlled by the system clock 47. Thus, the frame 
rate or image sampling frequency is essentially fixed 
for a particular system clock frequency. The total 

30 period corresponds to a maximum exposure period EP and 
the total processing time relating to an image data set 
RA(N,M) . The system clock frequency may be adjusted to 
scale the image sampling frequency, thereby adjusting 
EP. In summary, the maximum exposure period, the 

35 operating or sampling period, the signal processing 

time and the frequency of the system clock 47 should be 
considered in each application. 
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Alternatively, if an anti-blooming device is 
incorporated in the photosensor array 32, such as is 
well known to those skilled in the art, then the peak 
light signal P(z) may be determined by calculating an 
average value of Y percent of the highest photosensor 
element signal values for each zone, where Y is 
preferably 10, but may be in the range of 1 to 25. 
When using this approach for determining P(z), it is 
also preferable to include logic to adjust the sampling 
rate or operating frequency of the logic circuit 46 to 
an appropriate value depending on B u . 

The general background light signal B, whether B t or B Lt , 
and the peak light signal P(z) for each zone of the 
photosensor array 32, as determined in steps S150 and 
S160, are then used by the logic circuit 4 6 to 
determine a mirror control signal V c (z) as a function of 
the ratio of B n (n preferably has a value of one but may 
typically range from 0.8 to 1.3) to P(z), i.e., 
V c (z) - /(B n /P(z)). The control signal V c (z) is then 
output to the mirror drive circuits 24 in step S180 to 
drive the mirrors 28 or segments thereof to their 
desired reflectance level in the steps S200 and S210. 

Figure 12 shows the logic flow chart and method for the 
vehicle interior monitoring system or mode. 

In step S301, the logic circuit 46 initializes the 
system, sets EP to its maximum and if used, SSI to a 
predetermined minimum, such as zero. Next in step 
S3 10, the logic circuit 46 reads any analog control 
input signals 70 (70a to 7 On of Fig. 6 A) and/ or digital 
control input signals 75 (75a to 75n of Fig. 6A) that 
may be used in the vehicle interior monitoring mode. 

In step S315, the photosensor element signals are 
generated, processed and stored in RAM 50 by the logic 
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circuit 46 (see steps S101 to S140 of Fig. 7) . The 
logic circuit 46 also applies the lens correction 
factor LC(n,m) to each digital value Val RA(n,m) 
indicative of the photosensor element signal L(n,m) of 
5 each photosensor element 32a in the RAM array RA(N,M) 
to correct for the effect of lens 30. This results in 
RA(N,M) containing the lens corrected digital value Val 
RALcf^m) indicative of the photosensor element signal 
of each photosensor element 3 2a. 

10 

Next, in step S320, the logic circuit 4 6 determines the 
array response AR, which is indicative of either 
RA(N,M) (an entire image data frame or set RA (t) at 
time t) or of a selected sub-array or sub-set thereof 

15 RS(N s ,M s )(a partial image data frame or set RS (t) at 
time t) , where N s and M s are the row and column 
dimensions corresponding to a selected sub-array S(X) 
of the photosensor array 32. The logic circuit 46 
processes the image data frame RA (t) using one of the 

20 methods described below to determine the array 

response AR. An appropriate operating point range OP ± 
R is associated with each AR calculation method. 

The preferred method for determining AR is the array 
25 average method, in which the logic circuit 46 

determines AR by averaging all of the data values 
Val RALc(n,m) in the image data frame RA (t) (or selected 
sub-array RS (l) ) where: 

xv L1 n m 

30 

for n=ltoN, m=ltoM. Using the array average 
method, it has been found that appropriate OP and R 
values are 127 and 20 (8-bit data resolution) , 
respectively; however, the operating point range may be 
35 non-symmetrical for some tasks by using non-symmetrical 
R values, such as +20 and -10. 
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An alternative method is the "no saturation" method, in 
which EP is set to its highest level at which there is 
no saturation or blooming in any photosensor element 
32a. In this case, the logic circuit 46 reduces EP 
5 until the peak value of RA (t) or RS (l) is within the 

operating point range OP ± R. It has been found that 
appropriate OP and R values are 249 and 5, 
respectively. Still another method involves maximizing 
the useful image area, in which the logic circuit 46 

10 determines AR by determining the difference between the 
number of photosensor elements 32a having digital 
values of 0 and the number having digital values of 2 55 
(8-bit data resolution). In this case, appropriate OP 
and R values are 0 and 5% of the number of photosensor 

15 elements 32a corresponding to the image data set RA (t) or 
sub-array RS (t) . It should be understood that the 
specific values, such as 127 and 255, are based on 8- 
bit data resolution and would be appropriately scaled 
for other data resolutions. 

20 

In step S330 and S360, it is determined whether AR is 
in the operating point range OP ± R- If AR is outside 
the range, then the image data frame is either too 
bright (AR>OP + R) or too dim (AR<OP - R) and EP and 

25 SSI are incrementally increased or decreased according 
to steps S340, S341, S342 or S350, S351, S352. This is 
repeated for every image data frame RA (t) . The system 
thus optimizes EP and SSI for the particular 
circumstances at system startup, and thereafter 

30 continues to adjust EP and SSI to maintain AR within 

the operating point range OP ± R as lighting conditions 
change . 

If AR is within the operating point range OP ± R, then 
35 the vehicle interior monitoring system/mode enters a 
primary task routine or mode in step S370, such as the 
vehicle intrusion detection system/mode (S400) of 
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Figure 12A or the compartment image data storage 
system/mode (S500) of Figure 12B. After completing the 
primary task routine, the program returns to the 
vehicle interior monitoring mode to generate and store 
another image data frame RA (t) . 

V, The Prefe rred Embodiments 

The general lighting conditions of the rearward scene 
can be defined as follows: the background light level 
of the viewed rearward scene is B and the peak light 
level for each zone or sub-array S(X) is P(z) . A 
contrast ratio C(z) may be defined as the ratio of the 
peak light level P(z) for each zone to the general 
background light level B; thus, C(z) = P(z)/B. Given 
the background light level B, the human eye can 
tolerate varying peak light levels in the viewed 
rearward scene up to a particular contrast ratio 
tolerance C T . Contrast ratios greater than C T initially 
cause discomfort and are generally known as glare. As 
the eye adjusts its light sensitivity to protect itself 
from the discomforting peak or glare light levels, 
vision is reduced and the glare may become disabling. 
Thus, the maximum tolerable peak light level P T of the 
viewed rearward scene is equal to the product of the 
contrast ratio tolerance C T and the background light 
level B, i.e., P T = C x x B. 

The desired reflectance Rd(z) of a variable reflectance 
mirror for each zone is that reflectance level which 
reduces a peak light level P(z) to a value equal to the 
maximum tolerable peak light level P T , i.e., 
P T = ^(z) x P(z) or Ra(z) = P T /P(z), and substituting 
the expression for P x , R d (z) - (C T x B)/P(z). However, 
the maximum tolerable contrast ratio C T varies across 
the population due to aging and other factors; 
accordingly, a sensitivity factor S may be used to 
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account for this variation in contrast tolerance 
sensitivity so that R^z) = (S x C x x B)/P(z). 
Selecting the desired reflectance Rd(z) for each zone 
provides maximum information from the rearward scene 
5 viewed in each mirror or mirror segment while reducing 
discomforting or disabling peak light levels to 
tolerable levels. 

The mirror control signal V c (z) required to obtain the 
10 desired reflectance Ra(z) depends on the particular 

variable reflectance mirror element that is used* For 
electrochromic mirrors, a voltage-reflectance 
relationship can be approximated and generally defined. 
In general, an electrochromic mirror has a reflectance 
15 level R having a maximum value of R x with an applied 
voltage V w of 0 volts. As the applied voltage V w is 
increased, the reflectance level R perceptually remains 
on the order of R x until V w reaches a value of 
approximately V t . As V w is further increased, the 

2 0 reflectance level R decreases approximately linearly 

until a minimum reflectance of approximately R 2 is 
reached at a voltage V 2 . Thus, the applied voltage V w 
can be approximately defined as: 
V w - Vi + (Ri - R) x (V 2 - V X )/(R X ~ R 2 ) 
25 Substituting desired reflectance R^z) for the 

reflectance R results in the mirror control signal, the 
voltage of which is determined as follows: 
V C (Z) - V x + (R x - S x C T x B/P(z)) X (V 2 - V X )/(R X - R 2 ) . 
To obtain a digital value V DAC (z) , V c (z) is scaled by a 

3 0 factor that is the ratio of the maximum digital value 

to the value V 2 ; thus, for eight-bit data resolution 
V DAC (z) m 255 V c (z)/V 2 , and substituting for V C (Z) : 
V^cfz) - 255^ + (Ri - S X x B/P(z))x(V 2 - V x ) / (R, - R^/V,. 

35 Figure 8A provides further detail on the steps S150 and 
S160 where the logic circuit 46 determines the 
background and peak light signals. More particularly, 
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steps S151, S152, S159 and S160 provide two processing 
loops for sequentially determining the digital values 
indicative of the photosensor element signals, 
Val RA(n,m), in the RAM array RA(N,M) for each of the 
5 photosensor elements 3 2a of the photosensor array 
PA(N,M) . 

In step S153, a lens correction factor LC(n,m) is 
applied to each digital value indicative of the 

10 photosensor element signal, Val RA(n,m) , to correct for 
the effects of lens 30, which results in a lens 
corrected digital value of the photosensor element 
signal Val RA^n,!*) . These effects are typically 
referred to as cosine effects or Lambert's Law effects, 

15 The lens correction factor LC(n,m) depends on the 

radial distance of the photosensor element 32a from a 
central axis of the lens 30, and is typically in the 
range of 1 to 15 but will depend on the geometry of the 
lens and the selected photosensor array- The lens 

20 correction factor LC(n,m) applied to each Val RA(n,m) 
may be calculated according to Lambert's Law each time 
Val RA(n,m) is processed. More preferably, the logic 
circuit 46 initially stores an array of values LC(n,m) 
in the RAM 50 for each photosensor element 32a of the 

25 photosensor array PA(n,m) during an initialization 
routine. Alternatively, the size of the photosensor 
elements 32a of the photosensor array 32 may be 
adjusted to correct for the lens effects at each 
photosensor element 32a. 

30 

As discussed, it has been found that light levels for 
headlights generally result in an eight-bit digital 
value greater than a peak threshold value F having a 
value of about 245. Correspondingly, during non- 
35 daylight operation of the automatic rearview mirror 

system 20, background light levels generally result in 
eight-bit digital values indicative of the light levels 
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incident on the photosensor elements 32a that are less 
than or equal to the peak threshold value F. 

Accordingly, the lens corrected value Val RA LC (n,m) is 
compared in step S154 to the peak threshold value F. 
If Val RA LC (n,m) is less than or equal to F it is used 
to increment a counter B^, in the logic circuit 46, by 
1 in step S157 (thereby indicating that a value less 
than or equal to F has been identified) and by 
increasing a value by the value of Val RA LC (n,m) in 
step S158, where B^ is the sum of all the values of 
Val RA LC (n,m) which are less than or equal to F. The 
background light signal B t is then determined in step 
S161 as follows: B t = B^/Bo™*- If Val RA^fn^m) is 
greater than F in step S154, then the logic circuit 46 
uses a counter P(z) indicative of the peak light levels 
for each of the zones or sub-arrays S(X) of the 
photosensor array PA(N,M) , which is incremented by 1 as 
previously described. More particularly, Val RA LC (n,m) 
is tested in step S155 to determine whether it 
originates from a particular zone or sub-array S(X), 
where X = 1 to Z. If Val RA LC (n,m) does not fall within 
a defined zone or sub-array S(X), then P(z) is not 
incremented; otherwise, P(z) is incremented in step 
S156 for the appropriate zone. 

If the photosensor array 32 is arranged to view the 
rearward area through the active layer of the variable 
reflectance element la, then a color correction factor 
CC is applied in step S162 to B t and P(z) to compensate 
for any reduction in transmittance when the reflectance 
level (and transmittance) of the rearview mirror 1 is 
reduced. The value of CC is determined from the last 
calculated value indicative of the digital mirror 
control signal V DAC (z) applied to the rearview mirror 1. 
In step S163, a change- limited background light signal 
B u is determined as has been described previously. 
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Figure 8B provides further detail on step S180 where 
the logic circuit 46 determines the appropriate digital 
mirror control signal V DAC (z) for each zone or sub-array 
S(X) and corresponding mirror 28. In steps S181 and 
5 S182, V DAC (z) is calculated for each mirror 28. In step 
S183, the logic circuit 46 reads a state INI of the 
reverse-inhibit switch 38 and if the vehicle is in 
reverse gear so that INI is high, then all digital 
mirror control signals V DAC (z) are set to 0 in step S184 

10 forcing the mirror 28 to its maximum reflectance level. 
In step S185, a state IN2 of the force-to-day switch 3 6 
is read and if IN2 is high, then all digital mirror 
control signals V DAC (z) are set to 0 in step 18 6 forcing 
the mirror 28 to its maximum reflectance level. 

15 Finally, in step S187, a state IN3 of the force-to- 
night switch 40 is read and if IN3 is high, then all 
digital mirror control signals V DAC (z) are set to 255 
(the maximum digital value for eight-bit data 
resolution) in step S188 forcing the mirror 28 to its 

20 minimum reflectance level. 

Figure 9 shows another view of the logic flow whereby 
the rearview mirror, the left side view mirror and the 
right side view mirror (or alternatively three mirror 

25 segments) are independently driven to their desired 
reflectance levels by the independent and separate 
control and drive signals using photosensor element 
signals from three photosensor element sets (i.e., the 
sub-arrays S(l), S(2) and S(3) of photosensor elements 

30 32a in the photosensor array PA(n,m)). The specific 
subroutines shown in Figs. 8A and 8B corresponding to 
the general steps shown in Fig. 7 are also used with 
the general steps shown in Fig. 9. 

35 In step S201, light incident on the lens 30 is focused 
in step S210 onto the photosensor array 32 comprising 
the first, second and third sets of photosensor 
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elements 32a in zones a, b and c, respectively. Next, 
in step S211, the light incident on the first 
photosensor element set in zone a generates a first set 
of photosensor element signals, which, in step S211' , 
5 are then stored in RAM and later used by the logic 
circuit 46 to determine a first peak light signal in 
step S212. 

In step S221, the light incident on the second 
10 photosensor element set in zone b generates a second 

set of photosensor element signals, while in step S231, 
the light incident on the third photosensor element set 
in zone c generates a third set of photosensor element 
signals. The second set of photosensor element 
15 signals, generated in step S221 are also stored in step 
221' in RAM and then used by the logic circuit 4 6 to 
determine a second peak light signal in step S222. 
Similarly, the third set of photosensor element 
signals, generated in step S231, is next stored in step 
20 S231' in RAM and then used by the logic circuit 46 to 
determine a third peak light signal in step S232. 

In step S213, photosensor element signals generated 
from selected photosensor elements on which light is 
25 incident in step S210 are used to determine the 
background light signal* 

In step S214, the logic circuit 4 6 uses the background 
light signal determined in step S213 and the first peak 

3 0 light signal determined in step S212 to determine a 

first control signal. Similarly, the logic circuit 4 6 
uses the background light signal of step S213 and the 
second peak light signal determined in step S222 to 
determine a second control signal in step S224. In the 

35 same manner, the background light signal of step S213 
and the third peak light signal of step S23 2 are used 
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by the logic circuit 46 to determine a third control 
signal in step S234. 

The first control signal determined in step S214 is 
5 used by the drive circuit 24a to generate a first drive 
signal in step S215. This first drive signal drives 
the rearview mirror 28a to a desired reflectance level 
in step S216. Likewise, the second control signal 
determined by the logic circuit 46 in step S224 is used 

10 by the drive circuit 24b to generate a second drive 
signal in step S225, which is then used to drive the 
left side view mirror 28b to a desired reflectance 
level in step S226. Finally, the third control signal 
determined by the logic circuit 46 in step S2 34 is used 

15 by the drive circuit 24c to generate a third drive 
signal to drive the right side view mirror 28c to a 
desired reflectance level in step S236. Of course, the 
first, second and third control signals may also be 
used to control the segments of a mirror 28. 

20 

Finally, as previously discussed, one advantage of the 
present invention is that it is able to use a single 
photosensor array 32 to determine both a background 
light level and a peak light level for controlling the 

25 reflectance level of a mirror. This is especially 
advantageous where the sensor must be placed outside 
the interior of the vehicle to view the rearward scene. 
This may be required, for example, in certain truck 
type vehicles where only exterior side view mirrors may 

3 0 be used and automatic operation is desired. 

Accordingly, the photosensor array 32 may be located 
with each side view mirror. The other electronics for 
the automatic rearview mirror system 20, described 
previously, may be located either with the photosensor 

35 array 32 in each side view mirror, inside the vehicle 
cab or elsewhere in or on the vehicle. A desired 
reflectance level for each exterior side view mirror 
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may then be accurately determined using both the 
determined background light level and peak light level 
using only a single photosensor array 32 for each 
mirror. 

5 - * 

Figures 12 and 12 A show the logic flow charts of the 
vehicle interior monitoring system configured as a 
vehicle intrusion detection system (primary task S4 00) . 

10 In step S401, the current image data frame RA (t) is 

processed to enhance its contrast characteristics so 
that it is largely unaffected by changing light levels 
or shadows, etc. Preferably, the logic circuit 46 
selects an appropriate sub-array RS (t) corresponding to 

15 the sub-array S(X) (or other appropriate set) of 

photosensor elements 32a of the photosensor array 32 
containing the relevant image information. 

As discussed, the particular area of interest or 

20 significance in the photosensor array 3 2 may be a sub- 
array S(X) of photosensor elements 32a of the 
photosensor array 32 (or other appropriate set not 
necessarily rectangular in shape, such as a trapezoid) . 
The ability to select image data corresponding to S(X) 

25 is important because some sets of photosensor elements 
32a may provide image information that is redundant, 
irrelevant or even damaging to a particular application 
and should therefore be ignored by the logic circuit 
46. A significant advantage of the photosensor array 

30 32 over other sensing technologies is its ability to 
provide selected image information so that the logic 
circuit 46 need only process RS (t) when, for example, the 
relevant sub-array S(X) and corresponding sub-array RS (t) 
contain all the image information necessary to a 

3 5 particular application. For example, in the automatic 
rearview mirror and vehicle intrusion detection system 
described herein, a selected sub-array S(X) of 
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photosensor elements 32a may provide image information 
as shown in Figs. 3A and 3B, which may be used by logic 
circuit 46 to provide information regarding the 
location and intensity of the headlights of following 
5 vehicles. To the extent that other areas of the 
photosensor array 32 do not provide such image 
information, they may be ignored. Likewise, since the 
same photosensor array 32 may be used for vehicle 
intrusion detection, the logic circuit 4 6 need only 

10 process the image information of Fig. 2 A that excludes 
the image information of Figs. 3A and 3B. Without this 
ability to select particular sets or sub-arrays, at 
least more intensive processing may be required to 
distinguish between unauthorized activity within the 

15 vehicle and irrelevant activity outside the vehicle. 

After selecting the appropriate set of image data, the 
logic circuit 46 processes the values in RA (l) to enhance 
the contrast or robustness of that image data frame. 

20 Excluding photosensor elements 32a in the outside rows 
and columns of the photosensor array 32, every 
photosensor element E(n,m) has eight (8) adjacent 
photosensor elements 32a or neighbors: E(n-l,m) ; E(n,m- 
1); E(n-l,m-l); E(n+l,m) ; E(n,m+l); E(n+l,m-l) ; 

25 E(n-l,m+l) ; and E(n+l,m+l) . Therefore, a contour value 
CV(n,m) for each photosensor element E(n,m) may be 
calculated by determining the average of the 
differences between the value Val RA LC (n,m) of the 
photosensor element E(n,m) and the value of each 

3 0 neighbor. If the photosensor element value is an n-bit 
value, then CV(n,m) is also an n-bit value. Thus, 
using 8-bit data resolution, for example, if E(n,m) has 
a 0 value and each neighbor has a value of 255, then 
CV(n,m) is 255. If E(n,m) has a value of 255 and each 

35 neighbor has a 0 value, then CV(n,m) is 255. Both 
examples indicate a high degree of local contrast or 
discontinuity. On the other hand, if E(n,m) and each 



neighbor has a value of 127, then CV(n,m) is 0, which 
indicates a low degree of local contrast. Thus, the 
logic circuit 46 uses the above method, to determine 
the contrast value CV(n,m) for each value Val RALc(n,m) 
5 of RA^ to obtain a contour enhanced image data frame 
RC W in which the "harder" image contours or 
discontinuities are emphasized or enhanced, while 
"softer" image contours are reduced in significance. 

10 Next, in step 5402, the logic circuit 46 correlates the 
current image data frame RC W and a reference image data 
frame RC^p^ by comparing them to determine an image 
correlation factor IC, This factor is indicative of 
the correlation or degree of similarity (or difference) 

15 between the two image data frames independent of the 
particular image or photosensor array size. An IC 
value of 0 indicates no image similarity and an IC 
value of 1 indicates a perfect match. In particular, 
the image correlation factor IC is indicative of the 

20 number of corresponding photosensor elements 32a within 
the photosensor array 32 (or sub-array S(X)) having the 
same value Val RA LC (n / m) within some tolerance value T 
for the current and reference image data frames or 
sets. The tolerance value T accounts for minor image 

25 variations, such as may be caused by system vibration 
or other system "noise". Thus, the value from the 
current image data frame RC W corresponding to 
photosensor element £(1,1) is compared with the value 
from the reference image data frame RCj^^ 

30 corresponding to photosensor element E(l,l), and if: 

Val RC (0 (1,1) - Val RCjsp^d,!) ± T, 

then the RC W and RC^^ values of photosensor element 
35 E(l,l) correlate. This is done for all photosensor 
elements 32a within the photosensor array 32 or 
selected sub-set thereof, and the logic circuit 46 
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stores and sums each correlation occurrence for each 
element E(n,m) . The logic circuit 4 6 then divides the 
resulting sum of correlation occurrences by the number 
of elements E(n,m} considered in determining the image 
5 correlation factor IC. 

Next, in step S403, the logic circuit 46 determines 
whether certain system start-up criteria are met. This 
is done to ensure that a stable image data frame RC^ is 

10 stored as RC^p^. Importantly, RC,^ must correspond to 
an optimized and stable image data frame RC (0 . When 
power is initially supplied to light sensing and logic 
circuit 26, electrical and thermal transients occur as 
is typical for silicon integrated circuits. For the 

15 system described herein, satisfactory start-up criteria 
include: (1) a minimum number of image data frames that 
must be processed to allow electrical stabilization and 
the completion of the majority of EP and SSI 
optimization, where the minimum number of data frames 

20 is preferably 25 but may be in the range of 15 to 40; 
and (2) a stable reference image RCjm^, where RCj^^ is 
sufficiently stable when AR is within the operating 
point range OP ± R and IC exceeds 0*95 for at least 2 
to 10 image data frames, but preferably 4 image data 

25 frames. 

If the start-up criteria are not met in step S403, 
then, in step S404, the logic circuit 46 stores RC W in 
RAM 50 as a reference image data frame RCj^^ (which is 
30 RCma^n where the current image data frame is RC^on the 
next system cycle) and the program returns to step 
S3 10. If the start-up criteria in step S403 are met, 
then the program goes to step S405. 

35 In steps S405 and S406, threshold values T x and T 2 are 
used to determine the degree to which the current and 
reference image data frames match or mismatch. The 
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stores and sums each correlation occurrence for each 
element E(n,m) . The logic circuit 46 then divides the 
resulting sum of correlation occurrences by the number 
of elements E(n,m) considered in determining the image 
5 correlation factor IC. 

Next, in step S403, the logic circuit 46 determines 
whether certain system start-up criteria are met. This 
is done to ensure that a stable image data frame RC m is 

10 stored as RC*^. Importantly, RCr^ must correspond to 
an optimized and stable image data frame RC (C . When 
power is initially supplied to light sensing and logic 
circuit 26 , electrical and thermal transients occur as 
is typical for silicon integrated circuits* For the 

15 system described herein, satisfactory start-up criteria 
include: (1) a minimum number of image data frames that 
must be processed to allow electrical stabilization and 
the completion of the majority of EP and SSI 
optimization, where the minimum number of data frames 

20 is preferably 25 but may be in the range of 15 to 40; 
and (2) a stable reference image RC*^, where RC^p^ is 
sufficiently stable when AR is within the operating 
point range OP t R and IC exceeds 0.95 for at least 2 
to 10 image data frames, but preferably 4 image data 

25 frames. 

If the start-up criteria are not met in step S403, 
then, in step S404, the logic circuit 46 stores RC W in 
RAM 50 as a reference image data frame RC^ (which is 
30 RCr2f<m) where the current image data frame is RC w on the 
next system cycle) and the program returns to step 
S310. If the start-up criteria in step S403 are met, 
then the program goes to step S405. 

35 In steps S405 and S406, threshold values T t and T 2 are 
used to determine the degree to which the current and 
reference image data frames match or mismatch. The 
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values of T x and T 2 depend on the particular application 
and the degree of confidence or reliability required in 
the match/mismatch conditions of steps S405 and S406. 
For the vehicle intrusion detection system, it has been 
5 found that appropriate threshold values may range from 
0.0 to 0.6 for T| and from 0.95 to 1.0 for T 2 , but are 
preferably 0.6 and 0.95 for T x and T 2 , respectively. 
Due to image or system variations, perfect image 
correlation does not normally occur; therefore, 
10 compared image data frames having an IC value greater 
than 0.95 are considered a match, those having an IC 
value less than 0.6 are considered a mismatch and those 
having an IC between T x and T 2 are neither a definite 
match nor a definite mismatch. 

15 

More particularly, if IC exceeds Tj in step S405, then 
the logic circuit 46 determines whether IC exceeds T 2 in 
step S406. If IC does not exceed T 2 , then the program 
returns to step S3 10 since there is neither a match nor 

20 a mismatch condition. If IC does exceed T 2 , then there 
is a match and the logic circuit 46 updates the 
reference image data frame RCr^. It should be 
understood that RCr^ may be the same as RC (t) or may 
represent any appropriate combination of two or more 

25 image data frames. For example, RCr^ may be 
determined using a digital lag filter: 

RCREF(t) = R^REF(t-l) + K X(RC (t) — RCreF(M)) / 

3 0 where K may be a constant. After the logic circuit 46 
updates RCr^ and stores it in the RAM 50, the program 
again returns to step S3 10. 

If IC does not exceed T x in step S405, then the image 
35 data frames are considered a mismatch. Even though T x 
is selected so that only significant differences 
between RC (l) and RC^p^ provide a mismatch condition, the 
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logic circuit 46 determines in step S408 whether the 
mismatch condition is a valid intrusion condition. 
This is because there are conditions that result in the 
logic circuit 46 erroneously determining a mismatch 
5 condition. For example, automotive electrical system 
noise may affect the ability of the photosensor array 
32 to provide accurate photosensor element signals, 
although this normally occurs only for short periods 
given the nature of such noise. While not all system 

10 applications may require the same level of confidence 
for a correct mismatch condition, it has been found 
that requiring a number of successive mismatch 
conditions represents a good validation test for step 
S408. In particular, it has been found that this 

15 validation test better ensures that the mismatch 
condition is valid by requiring from 2 to 3 00 
successive mismatch conditions. Alternatively, the 
validation test may require from 2 to 3 00 initial 
mismatch conditions and allow a number of match 

2 0 conditions in step S405, where the number of match 

conditions may be from 1 to 15 depending on the 
required number of mismatch conditions. 

If the logic circuit 46 determines that the mismatch 
25 condition is not valid in steps 408, then the program 
will go to step S3 10. If the mismatch condition is 
valid, then the logic circuit 46 outputs one or more 
control signals in step S4 09. The control output 
signals are generally of two types: (1) signals that 

3 0 may be used to control directly certain vehicle 

hardware (lights, horn, etc.); and (2) signals that may 
be used as inputs to other vehicle controller systems 
that directly interface with such hardware. The logic 
circuit 46 may output any combination of these control 
35 output signals depending on the desired level of 

integration between the system of the present invention 
and other vehicle systems. Digital control signals, 
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such as bistable signals or digitally coded words 
interpreted by other vehicle systems, are typical for 
most applications. If the logic circuit 46 outputs 
bi-stable control signals directly to vehicle hardware, 
then the control output signal lines may be latched in 
a high or low state to control the vehicle hardware. 
If the logic circuit 46 outputs control signals to a 
vehicle controller system, then a higher protocol 
level, (such as digitally coded words) may have to be 
output from the logic circuit 46. 

Figure 12B shows the logic flow chart of the 
compartment image data storage system configuration 
(primary task routine S500) of the vehicle interior 
monitoring systems of Fig. 12. 

In step S501, the image data frame RA (t) (although this 
may be RC (t) ) is tested to determine whether it is valid. 
To determine whether RA (t) is valid in step S501, the 
logic circuit 46 may determine whether the array 
response AR is within the operating point range OP ± R. 
More stringent validity tests may include vehicle 
feature recognition, in which the system attempts to 
identify reference vehicle features, such as the seats 
or window pillars, and if the logic circuit 4 6 cannot 
identify these reference features in RA (t) , then it 
determines that RA (t) is invalid. If RA (t) is valid, then 
RA< 0 may be optionally compressed in step S502 using any 
appropriate digital compression method to reduce the 
amount of image data. Next, in step S503, the logic 
circuit 46 stores the image data in the nonvolatile 
memory 57 on a first-in-first-out (FIFO) basis. As 
will be described further below, the program may end or 
return to step S3 10 to obtain and process additional 
image data frames depending on the particular 
application. If RA (l) is not valid, then in steps S504, 
S505, S506 and S507, the logic circuit 46 determines 
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whether the photosensor 2 has been intentionally 
defeated so that an accurate image data frame of the 
vehicle interior or compartment cannot be generated and 
stored in the nonvolatile memory 57. 

5 

More particularly, in steps S504 and S506, if it is 
determined that both EP and SSI are minimums, then the 
photosensor 2 is probably being defeated by an intruder 
or vehicle thief who is blinding the photosensor 2 by 

10 directing a light source, such as a bright flashlight, 
directly at the photosensor 2. This action saturates 
the photosensor array 32 so that the image data frame 
appears "white". Since the photosensor array 32 
normally does not saturate when both EP and SSI are at 

15 their minimums, a "white" image data frame would not 
normally occur. In steps S505 and S507, if it is 
determined that both EP and SSI are maximums, then the 
photosensor 2 is probably being defeated by an intruder 
who is blinding the photosensor by placing a piece of 

20 tape or other opaque material over the lens 30 (or 
window) which the photosensor array 32 uses for 
"seeing" the vehicle interior 100. This action results 
in a "black" image data frame. Since SSI is maximized 
to allow the photosensor array 3 2 to generate images 

2 5 even if there is insufficient natural light, a "black" 

image data frame would also not normally occur. 

If steps S504, S505 and S507 result in a "black" image 
condition or steps S504 and S505 result in a "white" 

3 0 image condition, then the logic circuit 46 outputs a 

control signal in step S508 to the vehicle controller 
to disable the ignition control device and/ or to the 
vehicle controller system to activate the horn and 
lights. Otherwise, EP and SSI have not reached their 
35 adjustment limits, and the system attempts to optimize 
them and generates another image data frame which is 
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then again tested to determine its validity in step 
S501. 

VI. Integrated Headlight Control System 

5 

It is generally important for driver safety reasons 
that the headlights and sidelights of operating 
vehicles are turned on as night approaches or when 
background lighting levels fall below approximately 500 
10 lux* More particularly, it is desirable to have the 
vehicle's headlights and sidelights automatically turn 
on when background lighting levels fall to a 
sufficiently low level and automatically turn off when 
background lighting levels rise sufficiently. 

15 

While there are other automatic headlight control 
systems, such systems require that the photocells, 
which are used to control the headlights, be located 
and positioned so that they generally face upward 
2 0 either to avoid the effects of oncoming headlights for 
generally forward facing photocells or to avoid the 
effects of following headlights for generally rearward 
facing photocells. 

25 An advantage of the automatic rearview mirror system 2 0 
is that the background light signal B u may be used to 
automatically turn on and off a vehicle's headlights 
and sidelights by controlling the vehicle lighting 
switch 45. Importantly, since B u is determined 

30 regardless of the presence of peak light sources, such 
as oncoming or following headlights, the directional 
constraints on how and where the sensor is located or 
positioned are avoided. Accordingly, using the 
photosensor array 32 of the present invention to 

35 provide additional vehicle lighting control functions 
results in lower costs and improved reliability over 
other headlight control systems. 
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The limited background light signal B u has been 
described for the purpose of controlling the 
reflectance levels of an automatic rearview mirror 
system 20. Additionally, the logic circuit 46 may use 
5 B a to generate a vehicle lighting control signal to 
control the vehicle lighting switch 45 to turn on and 
off automatically the vehicle's headlights and 
sidelights. The ability to use B u is important because 
the vehicle lighting switch 45 should not be responsive 

10 to rapid or small fluctuations in background light 

levels in the region of the desired point at which the 
vehicle lighting switch is turned on or off, i.e., the 
switch point. Such fluctuations can be caused by the 
shadowing effect of overhanging trees or structures or 

15 the lighting differences between the eastern and 
western skylines at dawn and dusk which may be 
encountered when turning the vehicle. 

Additionally, hysteresis is also provided between the 
20 switch-on and switch-off conditions of the vehicle 
lighting switch 45 to further stabilize operation of 
the switch 45 in such fluctuating light conditions. 
More specifically, if the required switch point for 
falling light The levels is SP, then the switch point 
25 for rising light levels is SP x (1 + H) , where H is a 
hysteresis factor typically in the range of about 0.005 
to 0.5, but is preferably 0.2. Thus, if B u is less 
than SP, then the vehicle lighting control signal to 
the vehicle lighting switch 45 is set high to turn on 
3 0 the vehicle's headlights and sidelights. If B Lt is 
greater than SP x (1 + H) , then the vehicle lighting 
control signal to the vehicle lighting switch 45 is set 
low to turn off the vehicle's headlights and 
sidelights. 

35 

Additionally, if the photosensor array 32 and logic 
circuit 46 are both powered directly by the vehicle's 
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electrical system through the ignition switch, then a 
time delay t d may be provided such that if the ignition 
switch is turned off when the headlight control signal 
is set high, the vehicle lighting control signal will 
5 remain high for a time t d and thereafter fall to a low 
value to turn off the vehicle's headlights and 
sidelights. A manual control may also be provided to 
allow the driver to adjust the time delay t d . 

10 The vehicle lighting control signal and, more 

specifically, the lighting control switch 45 may also 
be used to inhibit automatic control of the automatic 
rearview mirror system 20. For example, if the vehicle 
lighting control signal indicates that the vehicle 

15 lighting should be turned off, then the logic and 

control circuit 34 may be used to enable sensitivity 
switch 42 or some other switch allowing the driver to 
manually adjust the reflectance level of the mirrors 
28. Thus, the driver may manually select a lower 

20 reflectance level during daylight conditions to provide 
protection against peak light sources, such as a bright 
setting sun. As background light levels fall or during 
non-daylight conditions, the vehicle lighting control 
signal would indicate non-daylight conditions and the 

25 logic and control circuit 34 may then be used to 
disable manual control and return the automatic 
rearview mirror system 20 to full automatic control. 

Figure 6B shows another embodiment of a stand-alone 
30 vehicle lighting control system, which has a number of 
the components identified with respect to Fig. 6. The 
vehicle lighting control system of Fig. 6B may also be 
integrated with automatic rearview mirror system and 
vehicle interior monitoring system described herein. 
35 In Fig. 6B, however, the photosensor array 32 is 

directed generally forward of the vehicle so that it 
may sense a field of view forward of the rearview 
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mirror 1. The forward field of view is through the 
vehicle's front windshield and generally in line with 
the primary vehicle direction. In the embodiment of 
the vehicle lighting control system as described 
5 herein, the photosensor array 32 comprises a plurality 
of photosensor elements 32a arranged in 160 columns and 
120 rows (a 160x120 array) and has a forward field of 
view of approximately 50 degrees centered at the 
vehicle center line and a vertical field of view of 

10 approximately 30 degrees, where the vertical field of 
view is approximately 10 degrees above and 20 degrees 
below the horizon in the forward field of view. It 
should be understood that the forward field of view may 
also be provided to the photosensor array 32 by using 

15 any appropriate image directing optics or other 

appropriate means for directing a forward field of view 
onto the photosensor array 32 regardless of its 
orientation. 

20 The logic and control circuit 34 processes the 

photosensor array signals corresponding to the forward 
field of view to determine an appropriate vehicle 
lighting configuration depending on the light 
information in the forward field of view. The methods 

25 used by the logic and control circuit 34 to determine 
the appropriate vehicle lighting configuration are 
described below. After determining the appropriate 
vehicle lighting configuration, the logic and control 
circuit 34 generates and applies control signals to 

30 headlight switches 29, which comprise a low beam mode 
switch 29a, a mid beam mode switch 29b and a high beam 
mode switch 29c, and to a vehicle running lights switch 
31 and tail lights and side lights switches 35. Also 
shown in Fig. 6B is a sensitivity control circuit 41, 

35 which may be used to control the level of hysteresis in 
the vehicle lighting control system, and manual vehicle 
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light switches 43 for manually controlling the vehicle 
lights. 

The photosensor array 32 is preferably located within 
5 the vehicle interior since this provides protection 

against the outside elements, including dirt, moisture, 
rain and snow, as well as reduced exposure to 
ultraviolet light, and generally provides a relatively 
controlled environment, including temperature 
10 environment. It should be understood, however, that 
the photosensor array 32 may also be located in one or 
both of the external sideview mirrors 4 and 5, or in 
any other appropriate location on the vehicle. 

15 The methods defined for determining the change- limited 
background light signal B u may also be used to 
determine a change-limited background forward light 
signal Bl^ that may be used to control the vehicle 
lighting system. Also, the methods previously 

2 0 described for determining and identifying peak light 
levels may generally be used to determine and identify 
whether there are other headlights and tail lights in 
the driver's forward field of view. The logic and 
control circuit 34 uses this information to control 

25 automatically the vehicle headlights (low beam, mid 

beam and high beam modes) so as to limit the annoyance 
or debilitation of other vehicle drivers forward of the 
vehicle. The method for processing the forward field 
of view image is the same as that shown through step 

30 S140 in the flow chart of Fig. 7A, and is generally the 
same as to steps S150 and S160 as detailed in the flow 
chart Fig. 8A, except that steps S155, S156 and S162 
are excluded. Figures 13 A, 13B, 13C and 13D are the 
flow charts that show the methods used by the logic and 

35 control circuit 34 to determine the appropriate vehicle 
lighting configuration and to control the vehicle 
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lighting system. The methods detailed in Figs. 13A, 
13B, 13C and 13D may generally be described as follows: 

After the logic and control circuit 34 determines B LFt , 
5 it determines whether exceeds a threshold B DD , which 
corresponds to the light level at dawn, dusk or a 
comparable lighting condition. If B m exceeds B DD , then 
a flag 

f day corresponding to a daytime condition, which 
indicates that the vehicle running lights, if any, may 

10 be turned on but that vehicle headlights and taillights 
should otherwise be off, and resets to zero flags F FLOW , 
f mid and f high/ which respectively correspond to the low, 
mid and high beam modes for the vehicle headlights. If 
B^ is less than B DD and exceeds a threshold B N/ which 

15 corresponds to a light level at night below which the 
mid or high beam modes may be operated, then the logic 
and control circuit 34 sets F LOW to 1 and resets F DAY , 
f me> an( * F HIGH* 

20 If Bus i s less than B N , then the logic and control 

circuit 34 processes a mid zone, which corresponds to a 
Sub-Array S(X) within the Array PA(N,M) of the 
photosensor array 32. This mid zone or zone of 
interest represents an appropriate area of the forward 

25 field of view image, in which the vehicle headlights 

may be set to their mid beam mode if there are no other 
vehicles as indicated by other vehicle light sources 
(headlights or taillights) within the mid zone. If 
there are no other vehicle light sources, then the 

30 logic and control circuit 34 sets F^ to 1 and resets 
F^. Otherwise, F LOW remains set, and the logic and 
control circuit 34 determines and processes the next 
set of photosensor element signals. 

35 If, however, F^ is set to 1, then the logic and 

control circuit 34 processes a high zone corresponding 
to the Array PA(N,M) . The high zone represents an 
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appropriate area of the forward field of view image, in 
which the vehicle headlights may be set to their high 
beam mode if there are no other vehicle light sources 
within the high zone. If there are no other vehicle 
5 light sources, then the logic and control circuit 34 
sets F mGH to 1 and resets F^. Otherwise, remains 
set, and the system determines and processes the next 
set of photosensor element signals. 

10 More complex vehicle lighting configurations may be 
controlled by determining an appropriate zone of 
interest for each available vehicle lighting mode or 
pattern . 

15 Also, as discussed above with respect to the first 
embodiment of a vehicle lighting control system, 
hysteresis is used to moderate the frequency of 
transitions between the various beam modes and is 
reflected in Figs. 13A, 13B, 13C and 13D by low beam 

2 0 counter LC, mid beam counter MC, high beam counter HC 
and night counter NC, each having corresponding 
hysteresis values LCI, MCI, HC1 and NCI, respectively. 
The hysteresis values may correspond to about 1 to 3 0 
forward field of view image frames, and therefore 

25 correspond to a certain period of time since each image 
frame takes on the order of about 0.1 seconds to 
process. It should also be understood that in the 
described embodiment, hysteresis has only been provided 
for transitions from low to mid or mid to high 

30 transitions, while transitions from high to mid or mid 
to low occur after the processing of only one image 
frame. Of course, hysteresis may also be used for 
transitions from high to mid or mid to low. Also, 
transitions to the initial low beam mode may be delayed 

35 on the order of 15 seconds to five minutes, rather than 
occurring within one image frame as described herein. 
Further, in addition to or alternatively to hysteresis, 
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specific time delays of from about 1 to 15 seconds, or 
any other appropriate delay be used for transitions 
between beam modes. 

5 Also, the vehicle driver may use the sensitivity 

control circuit 41 to adjust the level of hysteresis. 
The vehicle driver may also use the manual vehicle 
light switches 43 to override the vehicle lighting 
control system. 

10 

As discussed, Fig. 13A shows the initialization of the 
system and the initial low beam mode determination, 
Fig. 13B shows the initial mid and high beam mode 
determinations , Fig. 13C shows subsequent transitions 
15 from the mid beam mode to either the low or high beam 
modes, and Fig. 13D shows subsequent transitions from 
the high beam mode to the mid and low beam modes. 

As to Fig. 13A, in the initialization step S600, the 
logic and control circuit 34 sets flag F Day to 1, sets 
flags F^, F^, F ffl0 H and F N to 0, and sets counters LC, 
MC, HC and NC to 0. 

Next, in step S610, the logic and control circuit 34 
25 determines as previously described. In step S620, 
if is not less than B DD , then the logic and control 
circuit 34 determines whether LC equals or exceeds LCI 
in step S621. If LC is less than LCI, then LC is 
incremented in step S624 and the processing is returned 
30 to step S610. If LC equals or exceeds LCI, then the 

logic and control circuit 34 in step S622 sets F Day to 1, 
resets flags F^w, and F fflGH to 0 and also resets a 

flag F TSL , which corresponds to the status of the 
vehicle tail lights and side lights. Next, in step 
35 S623, the logic and control circuit outputs control 

signals to disable all vehicle night lights, including 
the headlights, side lights and tail lights. 




20 



If in step S620, is less than B DD/ then the system 

goes to step S630. In step S630, if LC exceeds 0, then 
LC is decremented in step S631 and the system returns 
to step S610, If LC equals 0 in step S63 0, then the 
logic and control circuit 34 sets F Day to 0 in step S640, 
and then goes to step S650. In step S650, if B LFt is not 
less than B^, then the logic and control circuit 34 
determines whether NC equals or exceeds NCI in step 
S651. If not, then NC is incremented in step S653. If 
yes, then NC is set to NCI in step S652. In either 
case, F N is then reset and the system goes to step 
S900. If B LFt is less than B N , the system goes to step 
S660. If NC exceeds 0 in step S660, then NC is 
decremented in step S661 and F N is reset in step S662, 
after which the system goes to step S900. If NC equals 
0 in step S660, then F N is set to 1 in step S67 0. 
Next, in steps S700 and S800, if F^ and F fflGH are not 1, 
then the system also goes to step S900. In step S900, 
F LOW and F XSL are set and LC is set to LCI. Next, in 
step S910, the logic and control circuit 34 enables the 
tail and side lights (TSL) and low beam mode, and 
proceeds to step S920. 

Next, Fig. 13B shows the logic for making an initial 
transition from the low beam mode to the mid beam mode 
and for making an initial transition from the initial 
mid beam mode to the initial high beam mode. Thus, in 
step S920, if F N equals 1, then the system returns to 
step S610. Otherwise, the logic and control circuit 34 
processes the Sub-Array S(X) in step S930 to determine 
whether there are any other vehicles (OV) in S(X) in 
the forward field of view, as previously described. In 
step S940, if OV is in S(X), then MC and HC are reset 
in step S941 and the system returns to step S610. If 
not, then the system goes to step S950. If MC does not 
equal or exceed MCI, then MC is incremented in step 
S951 and processing returns to step S610. Otherwise, 
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Fkqd is set and F^w is reset in step S960, and the logic 
and control circuit 34 outputs control signals to 
enable the mid beam mode and disable the low beam mode 
in step S970. Next, in step S980, the logic and 
5 control circuit 34 processes PA(N,M) to determine if 
there are any other vehicles (OV) in PA(N,M) . In step 
S990, if OV is not in PA(N,M) , then HC is incremented 
and the system returns to step S610. Otherwise, F raG H is 
set and F^ is reset in step S1000, after which the 
10 logic and control circuit 34 outputs control signals to 
enable the high beam mode and disable the mid beam mode 
in step S1010, and the system returns to step S610. 

As discussed, Fig. 13C shows the logic for making 

15 transitions from the mid beam mode to either low or 

high beam modes. Thus, if F^ equals 1 in step S7 00 of 
Fig. 13A, then the logic and control circuit 3 4 
processes S(X) for OV in step S710. If OV is in S(X) 
in step S720 f F LOW is set and F^ and MC are reset in 

20 step S721, after which the logic and control circuit 34 
outputs control signals to enable the low beam mode and 
disable the mid beam mode in step S722 and the system 
returns to step S610. If OV is not in S(X) in step 
S72 0, then the logic and control circuit 34 processes 

25 PA(N,M) for OV in step S73 0. In step S740, if OV is in 
PN(N,M), then HC is reset in step S741 and the system 
returns to step S610. Otherwise, in step S750, if HC 
does not equal or exceed HC1, then HC is incremented in 
step S751 and processing returns to step S610. If HC 

30 equals or exceeds HC1 in step S750, then F fflGH is set and 
Fmid is reset, after which the logic and control circuit 
34 outputs control signals to enable the high beam mode 
and disable the mid beam mode in step S770 and then 
returns to step S610. 

35 

Finally, Fig. 13D shows transitions from the high beam 
mode to the mid beam and low beam modes. Thus, if F„j GH 
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equals 1 in step S800 of Fig. 13 A, then the system goes 
to step S810, in which the logic and control circuit 34 
processes PA(N,M) for OV. In step S82 0, if OV is not 
in PA(N,M) , the system returns to step S610. 
5 Otherwise, F^ is set and F mGH and EC are reset in step 
S830, after which the logic and control circuit 34 
outputs control signals to enable the mid beam mode and 
disable the high beam mode in step S840. Next, in step 
S850, the logic and control circuit processes S(X) for 

10 OV. In step S860, if OV is not in S(X), then the 

system returns to step S610. Otherwise, F LOW is set and 
f mh> and Mc are reset in step S870, after which the 
logic and control circuit 34 outputs control signals to 
enable the low beam mode and disable the high beam mode 

15 in step S880 and then returns to step S610. 

Additionally, the above system may also be used to 
determine an appropriate vehicle lighting configuration 
and then controlling the vehicle lighting systems so as 

2 0 to improve the driver's forward field of view. For 

example, by providing the photosensor array 3 2 with a 
forward field of view, the system may be used to 
recognize veiling glare caused by scattered light that 
may be caused by fog, snow, rain or other adverse 
25 conditions. In particular, the logic and control 

circuit 34 may be used to determine a contrast factor 
representing the level of contrast within the forward 
field of view. This information may then be used to 
select the appropriate vehicle lighting configuration 

3 0 so as to reduce the level of veiling glare. 

The system may also be used to monitor varying 
windshield surface conditions caused by condensation, 
dirt, rain or snow. In particular, the system may be 
35 used to identify these conditions by analyzing the 

forward field of view image frames for distortion, or 
degradation. This capability may be enhanced by using 
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infra-red supplemental source illumination (SSI) having 
wavelengths within the responsive range of the 
photosensor array 32. 

5 More particularly, since the photosensor array 32 may 
have a forward field of view that includes at least the 
windshield area, which is swept by the windshield 
wipers, the logic and control circuit 34 may be used to 
generate control signals to operate the vehicle's 
10 windshield wiper system, windshield washer system, 

defogger system or windshield de-icing system so as to 
improve forward viewing conditions. 

Also, for a forward field of view, the photosensor 
15 array 32 may be used to generate image frame data that 
controls or supplements the control of vehicle 
collision avoidance systems or other automatic vehicle 
systems using forward field of view information. 
Additionally, since the photosensor array 32 responds 
2 0 to a portion of the non-visible electromagnetic 

spectrum, as previously described, it may be used to 
receive non-visible, spatially or time varying data 
from objects in the forward field of view, such as 
vehicles or road signs having an infra-red source 
25 emitter, and to provide vehicle-to-vehicle or road-to- 
vehicle communications, which may be used to support 
intelligent vehicle and highway systems (IVHS) , which 
are designed to improve road travel safety and 
efficiency. 

30 

VII. The Automatic Rearview Mirror And 
Vehicle Interior Monitoring System 

Figure 10 also shows the automatic rearview mirror 
35 system 20 of the present invention. The system 2 0 is 
powered by the vehicle's electrical system (not shown) 
to which the system 20 is connected. A voltage 
regulation and transient protection circuit 2 2 
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regulates power and protects the system 20 from voltage 
transients as is well known in the art. The circuit 22 
is connected to the vehicle's electrical system and to 
ground, and outputs a voltage of up to about 5 volts to 
5 power the mirror drive circuits 24 and the light 

sensing and logic circuit 26. The circuit 2 2 also has 
a ground line connected to the light sensing and logic 
circuit 26. 



10 The 5 volt line is also connected to the force-to-day 
switch 36 and the reverse- inhibit switch 38 (connected 
in parallel to the light sensing and logic circuit 26) 
which are used to force the mirrors 28 to their maximum 
4 reflectance level. More particularly, when either of 

jry 15 these switches is closed, they generate a high level 

signal Vh such as a 3 volt signal, which is input to 
3 the light sensing and logic circuit 26. This high 

F level signal overrides the normal operation of the 

1| light sensing and logic circuit 2 6 causing it to output 

M> 20 a control signal to the drive circuits 24 to drive the 

y mirrors 28 to their maximum reflectance level. 

In Conversely, when these switches are open, they each 

generate a low level signal V L such as a signal of less 
than 3 volts, thereby permitting normal operation of 
25 the light sensing and logic circuit 26, as has been 
discussed with respect to Figs. 7, 8A and 8B. The 
force-to-day switch 3 6 and the reverse-inhibit switch 
38 may be alternatively configured to generate a low 
level signal when closed and a high level signal when 
30 open. The force-to-day switch 3 6 is a manually 
operated switch and is preferably placed on the 
rearview mirror 28a and may be switch 3. The reverse- 
inhibit switch 38 is connected to a reverse inhibit 
line in the vehicle's electrical system (not shown) so 
35 that the reverse-inhibit switch 38 is actuated 

automatically whenever the vehicle is in reverse gear. 



The force-to-night switch 40, used to force the 
mirrors 28 to their minimum reflectance level, 
generates a high level signal V H when closed and a low 
level signal V L when opened. The signal V H or V L is 
then input to the light sensing and logic circuit 26. 
The high level signal may, for example, be between 3 to 
5 volts and the low level signal may be below 3 volts. 
The high level signal overrides the normal operation of 
the light sensing and logic circuit 26, as discussed 
with respect to Figs. 7, 8A and 8B, causing the circuit 
2 6 to output a control signal to the drive circuits 24 
to drive the mirrors 28 to their minimum reflectance 
level. The low level signal, on the other hand, 
permits normal operation of the light sensing and logic 
circuit 26. Alternatively, the force-to-night switch 
40 may be configured to generate a low level signal 
when closed and a high level signal when open. The 
force-to-night switch 40 is also a manually operable 
switch, preferably located on the rearview mirror 28a, 
and may also be switch 3 . 

The light sensing and logic circuit 26 is also 
connected to the sensitivity control circuit 42. The 
circuit 42 enables the operator to manually adjust the 
sensitivity of the mirrors 28 using the switch 3 (shown 
in Figs. 1A and IB). The sensitivity control circuit 
42 (switch 3) may comprise a potentiometer whose 
voltage may be varied from zero to five volts. 
Alternatively, a single resistor may be used to provide 
a single preset sensitivity setting that cannot be 
changed by the driver. 

As previously discussed with respect to Figs. 5 and 6, 
the light sensing and logic circuit 26 comprises the 
photosensor array 32 (or other light sensing device) 
and the logic and control circuit 34. These two 
devices may be either separate or commonly located on a 
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single semiconductor substrate. The light sensing and 
logic circuit 26 is preferably a single VLSI CMOS 
circuit. 

5 Also shown in Fig. 10 , the light sensing and logic 

circuit 26 outputs analog mirror control signals having 
voltages varying from zero to approximately 5 volts to 
the mirror drive circuits 24 and a vehicle lighting 
control signal of 0 to 5 volts to the vehicle lighting 

10 switch 45. Alternatively, as previously discussed the 
light sensing and logic circuit 26 may output a 5 volt 
pulse-width-modulated (PWM) signal to the mirror drive 
circuits 24. The mirror drive circuits 24 then 
generate and apply drive voltages varying from a low 

15 voltage on the order of 0 volts to a high voltage on 
the order of 1 volt to drive the mirrors 28. The 
actual driving voltage (or current) may, of course, be 
significantly lower or higher depending on the variable 
reflectance mirror element la used. 

20 

Each of the mirrors 28 preferably comprises a 
reflective electrochromic (EC) cell whose reflectance 
level may be varied from a maximum of anywhere from 
approximately 50 to 90 percent to a minimum of 

25 approximately 4 to 15 percent, and having a maximum 

driving voltage on the order of about 1 to 2 volts. As 
is well known in the art, electrochromic devices change 
their reflectance level when a voltage or other 
appropriate drive signal is applied to the 

3 0 electrochromic device. The mirrors 28 alternatively 
may comprise any other suitable variable reflectance 
mirror. 

As previously discussed, it is also within the scope of 
35 the present invention for the light sensing and logic 
circuit 2 6 to be located remotely from the mirrors 28 
of the system 20. However, depending on vehicle design 
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and styling requirements, it may be preferred that the 
light sensing and logic circuit 26 be integral with the 
rearview mirror 28a such that: (1) the center line of 
the field of view of the photosensor array 32 is 
5 substantially perpendicular to the reflective surface 
of the rearview mirror 28a; and (2) the horizontal 
field of view of the photosensor array 32 is aligned 
with the horizontal axis of the rearview mirror 28a. 
As a result , the photosensor array 32 receives the 
10 light that will be incident on the rearview mirror 2 8a 
as shown in Fig. 6. 

As has been discussed, the automatic rearview mirror 
system containing the photosensor array 32 may be 

15 extended to include a vehicle interior monitoring 
system configured as a vehicle intrusion detection 
system by vertically extending the effective field of 
view of the photosensor array 32 and by providing 
vehicle intrusion detection logic in the logic circuit 

20 26 ♦ Importantly, the automotive rearview mirror and 
vehicle interior monitoring systems do not have to 
function simultaneously in both the vehicle intrusion 
detection mode and automatic rearview mirror mode. 
Therefore, the operation of the vehicle intrusion 

25 detection mode may be described independently of the 

operation of the automatic rearview mirror mode. As is 
described further below, a switch is used to input a 
mode select signal to the logic circuit 4 6 to select 
the desired operating mode. 

30 

In the vehicle intrusion detection mode, those 
photosensor elements 32a corresponding to the image 
segment below the lower edge of the vehicle window 
areas (i.e., the image information of Fig. 2 A excluding 
35 the image information Figs. 3 A and 3B) are considered 
significant. Each photosensor element 32a is 
associated with a small and unique portion of the 
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imaged scene. In particular, each photosensor element 
32a senses light within its own image cone. For the 
preferred photosensor array 32, each photosensor 
element 32a is responsive to an area approximately one 
5 (1) inch square at 100 inches, which is about the 

maximum distance from the photosensor array 3 2 mounted 
in the rearview mirror 1 to most vehicle cabin interior 
surfaces within the area of interest. For the 
photosensor array 32 described above, one set of about 

10 6,400 (160 x 40 sub-array) photosensor elements 32a are 
used in the automatic rearview mirror mode and another 
set of about 12,800 (160 x 80 sub-array) photosensor 
elements 32a are used in the vehicle intrusion 
detection mode. The ability of the photosensor array 

15 32a to resolve the area of interest into a number of 

data values and to select particular image information, 
while ignoring other image information, is significant 
and distinguishes this vehicle intrusion detection 
system from other vehicle intrusion detection systems 

20 and technologies. 

The automatic rearview mirror and vehicle interior 
monitoring system as shown in the schematic block 
diagram of Figure 10A is identical to the automatic 

25 rearview mirror system shown in the schematic block 
diagram of Figure 10 except as follows. First, as 
explained above, the array size required for an 
independent automatic rearview mirror system must be 
expanded from 160 x 40 to 160 x 120 to provide a larger 

3 0 effective field of view that includes most of the 
vehicle interior 100. Second, additional logic or 
control circuitry is incorporated in logic circuit 4 6 
to process the vehicle intrusion detection logic of 
Figs. 12 and 12 A. The light sensing and logic circuit 

35 26 includes additional control input lines for the 
"arming" and "alerting" control input signals and 
control output lines to interface with vehicle hardware 
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or vehicle controller systems. Finally, the regulation 
and transient protection circuit 22 also has an 
additional vehicle power supply line (12V BATTERY) , and 
a switch or other logic for providing a mode select 
5 signal that is input to the light sensing and logic 
circuit 26. 

Normally, power is provided to vehicle hardware through 
the ignition switch controlled power supply circuits to 

10 avoid battery drain. Since the automatic rearview 
mirror system operates when the vehicle is being 
driven, it is normally connected to an ignition switch 
controlled power supply circuit as shown in Fig. 10. 
Since the vehicle intrusion detection system operates 

15 when the ignition switch is off, the regulation and 

transient protection 22 includes the additional vehicle 
battery power supply line for supplying power directly 
from the vehicle battery. The regulation and transient 
protection circuit 22 also includes a switch or other 

20 logic circuit (not shown) to output a mode select 

signal to the light sensing and logic circuit 26. The 
mode select signal is low (0 volts) when power is not 
available through the ignition switch controlled power 
supply circuit and high (5 volts) when it is. 

25 

The light sensing and logic circuit 2 6 includes an 
input line to receive an "arming" input signal 49a to 
actively arm the vehicle intrusion detection system. 

3 0 Although not shown in Fig. 10A, other vehicle systems 
are typically used to supply an "arming" input signal. 
Such systems may be actuated by using conventional 
infrared or RF type remote control or by the activation 
of central door locking systems using the door key or 

35 entry combination keypad. 



I 
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The light sensing and logic circuit 2 6 also includes 
input lines to receive an "alert" input signal (s) 49b 
to increase the sampling rate, such as when a trunk lid 
opening has been detected and increased monitoring may 
5 be required. The light sensing and logic circuit 26 
also includes one or more output signal lines to the 
vehicle hardware 45a and/or to the vehicle controller 
system 48, for activating the horn and lights or 
disabling the ignition control device. The control 
10 output signal is normally low (0 volts) and goes high 
(5 volts) when there is an intrusion condition, but may 
also be a data word providing more detailed 
information, (such as the location of the intrusion) to 
the vehicle controller system. 

15 

When power is supplied to the automatic rearview mirror 
system through the ignition switch controlled power 
supply circuit, the regulation and transient protection 
circuit 22 outputs a high (5 volts) mode select signal 
20 to the logic circuit 46. This causes it to select the 
automatic rearview mirror mode and the system functions 
as an automatic rearview mirror system as previously 
described. 

25 When the ignition switch is turned off, the mode select 
signal goes low (0 volts) and the logic circuit 4 6 sets 
the system to a low power mode, in which the logic 
circuit 46 only monitors the status of the mode select 
and "arming" control input signals. In this state, the 

30 vehicle intrusion detection mode is available, but the 
system is not "armed" and it is not monitoring the 
vehicle cabin. When in this state and when the 
"arming" control input signal is active, then the logic 
circuit 46 enters the vehicle intrusion detection mode 

35 described with respect to Figs. 12 and 12A. 
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As previously described, in step S301, the logic 
circuit 46 initializes the system (e.g., resets the 
counters, etc., used in the automatic rearview mirror 
mode) and sets EP to its maximum value and SSI to its 
5 minimum level. Since the lighting levels are not known 
and may be at any level within the full operating range 
of the system at the time of arming, the system must 
determine the optimum combination of EP and SSI by 
maximizing the number of photosensor elements 32a 
10 providing useful image data. To minimize system power 
consumption, the method is biased to minimize SSI and 
maximize EP. In step S3 10, the status of the mode 
select, "arming" and "alerting" signals is monitored to 
confirm the appropriate operating mode. For example, 
II 15 if the "arming" signal goes inactive, then the system 

returns to a disarmed, low power mode and only monitors 
the mode select and "arming" signals. If there is no 
k status change, then the system generates and stores RA (t) 

3 (using steps S101 to S140 of Fig. 7) . The logic 

* 20 circuit 46 ignores RAM array data corresponding to the 

;i 160 x 40 array of photosensor elements 3 2a generally 

.Li 

n associated with the window areas as shown in Figs. 3 A 

y and 3B, and processes the RAM array data corresponding 

to the 160 x 80 array of photosensor elements 32a 
25 generally associated with the vehicle cabin interior 
generally excluding the window areas of Figs. 3A and 
3B. It should be understood that a trapezoidal sub-set 
of RAM array data, corresponding to the same sub-set of 
photosensor elements 32a, may be selected so as to 
30 better correspond to the vehicle cabin interior 
excluding the window areas. 

In step S320, the logic circuit 4 6 determines AR by 
calculating the average value of all the values in the 
35 selected sub-set of RAM array data. In the system 

described, AR may be in they range 0 to 255 (8 -bit data 
resolution) , but it is preferably at the operating 
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point OP of 127 (mid-point of the range) ; however, for 
system stability purposes the range factor R results in 
an operating point OP range of 127 ± 20. In step S3 3 0 
and S3 60, it is determined whether AR is in the range 
5 OP ± R. If AR is outside the range, then EP and SSI 
are incrementally increased or decreased according to 
steps S341, S342 or S351, S352. This is repeated for 
every image data frame. The system thus optimizes EP 
and SSI for the particular circumstances at system 
10 startup, and thereafter continues to adjust EP and SSI 
to maintain AR within the range OP ± R as lighting 
conditions change. If AR is within the range, then the 
program enters the primary task S4 00 in block S3 70. 

15 The vehicle intrusion detection system is designed to 
be responsive or sensitive to movement or motion within 
the vehicle interior 100 and insensitive to changes in 
general lighting conditions, moving shadows, etc. The 
system does this by reducing every image data frame to 

2 0 its robust and unique characteristics, largely 
unaffected by random light sources or changes in 
general lighting conditions. After sufficient image 
data frames have been processed to allow electrical 
stabilization and optimization of EP and SSI, the 

25 contour enhanced image data frame RC (t) is stored as the 
reference image data frame. Every image data frame is 
processed in the same way as the reference image and is 
then compared to the reference image. Decisions are 
reached after several images have been compared 

30 producing the same result. Three conclusions are 
possible after comparing images in the manner 
described. Images may be essentially the same, 
significantly different or neither similar enough nor 
different enough to make a decision. If this first 

35 condition exists for long enough, changes to the 

reference image are considered. Confirmation of the 
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differences over several images result in a concluded 
intrusion. 

More particularly, in step S401, the logic circuit 46 
5 converts RA< t) to its contour enhanced form RC (t) by 

calculating the average difference between the value of 
RA (l) for each element E(n,m) and each of its eight (8) 
neighbors. As discussed, at system start-up, the 
system must electrically stabilize and must also adjust 

10 EP and SSI to optimize the image data frame stored as 
rc ref(d- This is done by cycling at least several times 
from step S3 10 through steps S4 03 and S4 04 and then 
returning to step S310. In step S404, the image data 
frame RC (l) is stored in RAM 50 as RCr^ so that RC (t) and 

15 RCref^) are available in step S402 in RAM 50 for 

comparison. In step S402, the correlation factor IC 
for RC (t) and RCref^ is determined. During this start-up 
period, EP and SSI become stable, 

20 In step S403, the start-up criteria are tested, as 

previously described, and if the count is greater than 
25 and the images RC (t) and RCrep^ correlate (IC exceeds 
0.95), then the system continues through step S405. 
Otherwise, it continues through step S404 until the 

25 image is stable. In the normal monitoring mode, IC is 
tested against T x in step S405, where T x is 0.6 (T x may 
be less than 0.6). If the degree of correlation or 
correspondence between the current and reference image 
data frames is poor (IC is less than 0.6), then the 

3 0 image data frames are judged to be sufficiently 
different to suggest that vehicle intrusion has 
occurred. Vehicle intrusion detection systems are 
evaluated on their ability to detect intrusion 
conditions and to avoid false intrusion conditions. To 

35 avoid false intrusion conditions, in step S408, the 

number of successive mismatch conditions is counted and 
compared to a preset value of 20 (which may be in the 
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range 2 to 300) , and a valid intrusion detection 
condition is established in step S408 after 20 
successive mismatch conditions. In step S4 09, the 
logic circuit 4 6 outputs control signals to vehicle 
5 hardware 45a or to the vehicle controller system 4 8 for 
further processing, which may result in an alarm 
sounding, vehicle immobilization or other appropriate 
action. The system continues to monitor the vehicle 
interior or compartment by returning to step S3 10. If 
10 the number of successive mismatch conditions falls 

below 20 in step S408, then the system returns to step 
S310. 

In step S405, if IC is greater than 0.6, then the 
images are not sufficiently different to confirm an 
intrusion condition. It is desirable to update the 
reference image data frame RCr^ if changes occur due 
to minor and slowly changing conditions outside the 
vehicle, such as changing light levels or slowly moving 
shadows due to the sun tracking across the sky. 
Accordingly, in step S406, IC is compared to T 2 (where 
T 2 is 0.95 but may be in the range 0.95 to 1), and if IC 
exceeds T 2 , then the logic circuit 46 updates and stores 
the reference image data frame RC^^ in step S407. The 
logic circuit 46 may replace RCrep^ with RC (t) or modify 
rc ref(M) as previously described. The system continues to 
monitor the vehicle interior by returning to step S3 10 
until the "arming" control input signal goes inactive. 

30 It should be understood that the larger field of view 
provided by the 160 x 12 0 array of the vehicle 
intrusion detection system enables further analysis of 
the rearward scene. Specifically, the background light 
signal B t may be determined using a larger set of 

35 photosensor array elements 32a. The combination of the 
automatic rearview mirror detection system and vehicle 
intrusion detection system additionally provides an 
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opportunity for using SSI to illuminate the vehicle 
interior under dark conditions for the purpose of 
precise identification of specific vehicle features 
such as those indicated in Fig. 2 A. 

5 

Vehicle feature identification is useful in the 
automatic rearview mirror system because it allows the 
logic circuit 46 to select each of the sub-arrays S(X) 
of photosensor elements 32a corresponding to zones a, b 

10 and c indicated in Figs. 3A and 3B. This is useful 
when the photosensor array 32 is positioned in the 
rearview mirror 1. Active adjustment allows the logic 
circuit 46 to select sets or sub-arrays S(X) of 
photosensor elements 32a such that zones a, b and c are 

15 indicative of identical vehicle regions independently 
of driver rearview mirror 1 adjustment. 

Finally , to minimize battery power drain, the system 
described may be operated in a low power mode by 

20 reducing the sampling rate at which images are obtained 
and processed , such as one image data frame per second. 
However, if the logic circuit 46 receives an "alerting" 
control input signal such as may be received from a 
vibration, motion, trunk lid or door opening sensor, 

25 then the system described herein may return to its 

normal sampling rate. Alternatively, this may also be 
achieved by having the system use the lower sampling 
rate until the logic circuit 4 6 establishes a poor 
image correlation (i.e., IC < 0.6) in step S406 and 

30 selects the higher sampling rate. 

The vehicle interior monitoring system may also be 
configured as a compartment image data storage system 
to store any compartment image, such as the driver 
35 image, in the nonvolatile memory 57. The automatic 

rearview mirror and vehicle interior monitoring system 
configured as a compartment image data storage system 



- 92 - 



is shown in the schematic block diagram of Fig, 10A and 
the previous description of Figs, 10 and 10A applies 
except as follows. First, in the specific embodiment 
described herein, the light sensing and logic circuit 
5 26 does not use control input lines for receiving the 
"arming" control input signal 49a and the "alerting" 
control input signal (s) 49b as in the vehicle intrusion 
detection system. Second, the additional vehicle power 
supply line (12V BATTERY) and mode select signal line 

10 are also not used in the specific embodiment described 
herein. This is because the compartment image data 
storage system may be limited to operating when the 
vehicle has been started since both authorized and 
unauthorized drivers actuate the ignition switch to 

15 start the vehicle (the vehicle thief may, of course, 
break the steering column ignition lock system to do 
this) . Thus, power is always supplied through the 
ignition switch controlled power supply (12V IGNITION) 
when the vehicle is started. Finally, the light 

20 sensing and logic circuit 2 6 includes input/ output 
lines to interface with the nonvolatile memory/data 
access logic and port 65, which comprises the 
nonvolatile memory 57, access/security decoding logic 
58 circuit and data access part 59 of Fig. 6A. To 

25 reduce data storage requirements, the image data frame 
may be compressed using any appropriate digital image 
compression technique as discussed with respect to Fig. 
6A. The image data frame is then stored in the 
nonvolatile memory 57, such as an EEPROM or any other 

30 appropriate nonvolatile memory, which has sufficient 
storage to store a predetermined number of image data 
frames • 

The compartment image data storage system may be 
35 configured to store a single image data frame in the 
nonvolatile memory 57 for each ignition cycle. When 
power is supplied to the automatic rearview mirror 
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system through the ignition switch controlled power 
circuit, the regulation and transient protection 
circuit 22 supplies 5 volts to the light sensing and 
logic circuit 26, which begins system initialization 
5 for a set period of between zero (0) seconds and two 
(2) minutes, but preferably 30 seconds. This delay 
condition or wait state reduces the opportunity for 
vehicle thieves to detect SSI which may be emitted 
during the image optimization process of Figure 12. 

10 After the wait state has ended, the compartment image 
data storage system operates as has already been 
described with respect to Figs. 12A and 12B. The 
nonvolatile memory 57 should be sufficiently large to 
store a number N of valid image data frames RA (t) to 

15 document N sequential ignition cycles where N is in the 
range of 2 to 10, but is preferably 5. The image data 
frames are addressed via pointers that select a general 
memory location which are used to store each valid 
image data frame RA^. The pointer addressing scheme is 

20 cycled on a first-in-first-out (FIFO) basis so that the 
most recent valid image data frames replace the 
"oldest" image data frames in the nonvolatile memory 
57. After storing a valid image data frame RA (t) , the 
system ends cycling and enters a dormant state waiting 

25 for the next ignition cycle. 

Alternatively, multiple valid image data frames may be 
stored for a single ignition cycle. This second 
version of the compartment image data storage system 

3 0 performs exactly as the first description except as 
follows. After storage of the initial image data 
frame, the system returns to step S3 10 and the logic 
circuit 46 generates a random wait state ranging from 8 
to 15 minutes during which the system stops generating 

35 image data frames. After the wait state has ended, the 
system proceeds to attempt generate another valid image 
data frame. This cycle of randomly waiting and then 
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attempting to generate valid image data frames is 
continued as long as the ignition supplies power to the 
system. This approach is more difficult for thieves to 
defeat. This system may also be configured as a real- 
5 time image data storage system (e.g., 3 0 frames per 
second) . Of course, since at least several hundred 
image data frames may need to be processed, compressed 
and stored in the nonvolatile memory 57, the processing 
and nonvolatile memory storage requirements are 

10 significantly greater than for the other image data 

storage systems described above. An initiation sensor, 
such as accelerometers, motion sensors, vibration 
sensors or any other sensor capable of detecting 
vehicle motion, inputs an initiation signal, and after 

15 receiving the initiation signal, the light sensing and 
logic circuit 26 generates and stores in real-time the 
image data frames for a predetermined period, such as 
10 seconds. 

2 0 The nonvolatile memory 57 is preferably housed in a 
separate module in a physically difficult to access 
location within the vehicle, such as high on the fire 
wall behind the instrument cluster. The module is 
preferably a durable metal housing or other housing 

25 sufficiently durable so that it will protect the 

nonvolatile memory 57 from extreme shock or heat, such 
as might occur in a vehicle accident. To better ensure 
that the image data frames in the nonvolatile memory 57 
are not accessed by unauthorized personnel, access may 

30 be limited by the security access/decoding logic 58. 

The security access codes necessary to access the image 
data frames may, for example, be distributed only to 
authorized persons. When the proper security access 
code is entered, the image data frames may be accessed 

35 through the access port 59; typically, the access port 
59 is a multi-pin connector to which a data retrieval 
system may be connected. 
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It should be understood that the vehicle interior 
monitoring system described above, including the 
vehicle intrusion detection system and the compartment 
image data storage system configurations, may be 
5 implemented as an independent or stand-alone system in 
a module (without the automatic rearview mirror 
system) , and that it may be mounted independently 
within the vehicle, such as in the headliner, headliner 
console or other appropriate areas. 

10 

The performance of the vehicle interior monitoring 
systems described herein may be enhanced by providing 
enhanced infrared reflectance characteristics in 
certain areas within the vehicle interior 100. For 

15 example, some fibers (such as cotton and silk) tend to 
reflect near infrared illumination better than other 
fibers (such as nylon and rayon) which tend to absorb 
near infrared illumination. Therefore, a pattern may 
be established in the vehicle interior 100 such as on 

20 the driver seat 101 or passenger seat 102 or front or 
rear seats or on the vehicle's interior door panels, 
etc., by using different fibers or other materials to 
establish a pattern, such as a grid or any other 
appropriate pattern* Near infrared illumination of the 

25 pattern provides a higher contrast image to the 

photosensor array 32. This better ensures that the 
logic circuit 46 accurately determines, for example, 
the presence of an intruder, an occupant or other 
object (such as a child restraint system in the front 

3 0 passenger seat) . 

Using fibers or materials having better infrared 
reflectance characteristics as described above is 
useful both during the day and at night. During the 
35 day, any near infrared reflective pattern in the 
vehicle will generally provide a higher contrast 
pattern to the photosensor array 32 because of natural 
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sources (sunlight) or supplemental sources of near 
infrared of illumination. In particular, if light 
levels fall below some predetermined level (typically 
in the range of about 0 . 1 lux to 5 lux) , then near 
5 infrared SSI may be used to provide a higher contrast 
image pattern to the photosensor array 32. 

The vehicle interior monitoring system may also be used 
to monitor the vehicle interior 100 to determine 

10 whether there is an adult occupant, a child restraint 
system or no occupant in the front or rear passenger 
seat areas. Various mechanical and electrical sensors 
have been considered or used for detecting or sensing 
the size and presence of vehicle occupants, 

15 particularly those in the front passenger seat. These 
sensors include pressure sensors (mechanical and solid- 
state) , accelerometers, ultrasonic sensors and 
mechanical or electrical switch mechanisms for 
indicating seat belt use. As air bags are becoming 

20 more prevalent, vehicle owners, insurance companies and 
automotive companies have a strong interest in having 
air bags deploy properly at all times, since replacing 
deployed airbags is costly. Additionally, there has 
been some discussion as to whether air bags should 

25 deploy when there is a child restraint system that is 
positioned rearwardly facing in the front passenger 
seat. Since performance requirements are stringent for 
safety related components, it is problematic to make 
appropriate airbag deployment decisions using currently 

3 0 known sensor technologies. The vehicle interior 
monitoring system may be configured as a vehicle 
occupant detection system that may be used to aid in 
the intelligent deployment of air bags depending, for 
example, on the status of the vehicle occupant. Image 

35 information, such as size, shape, contour and motion 
may be processed by the logic circuit 46 to determine 
whether to output a control signal to the air bag 
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deployment system to prevent an air bag from deploying 
(such as a passenger air bag when there is no front 
seat passenger) or for controlling the rate at which 
the airbag deploys* 

5 

The individual components represented by the blocks 
shown in the schematic block diagrams of Figs. 6, 6A, 
6B, 10 and 10A are well known in the art relating to 
automatic rearview mirrors, vehicle lighting systems 

10 and vehicle intrusion detection systems, and their 

specific construction and operation is not critical to 
the invention or the best mode for carrying out the 
present invention • Moreover, the logic flow charts 
discussed in the specification and shown in Figs* 7, 

15 8A, 8B, 12, 12A, 12B, 13A, 13B, 13C and 13D may be 
implemented in digital hardwired logic or programmed 
into well-known signal processors, such as 
microprocessors, by persons having ordinary skill in 
the art. Since such digital circuit construction or 

20 programming per se is not part of the invention, no 
further description thereof is deemed necessary. 

While the present invention has been described in 
connection with what are the most practical and 

25 preferred embodiments as currently contemplated, it 

should be understood that the present invention is not 
limited to the disclosed embodiments. Accordingly, the 
present invention is intended to cover various 
modifications and equivalent arrangements, methods and 

30 structures that are within the spirit and scope of the 
claims. 
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WHAT IS CLAIMED IS; 

1. An automatic rearview mirror system for an 
automotive vehicle comprising: 

at least one variable reflectance rearview mirror; 

an array of sensing elements to sense light levels 
in an area rearward of said at least one variable 
reflectance rearview mirror, each of said sensing 
elements adapted to sense light levels of light 
incident thereon and to output an electrical signal 
indicative of said sensed light levels; 

a signal processor, connected to said array of 
sensing elements, receiving and using the electrical 
signals indicative of the sensed light levels from said 
sensing elements to determine a first electrical signal 
indicative of a background light level in the area 
rearward of said at least one variable reflectance 
rearview mirror and to determine a second electrical 
signal indicative of at least one peak light level in 
the area rearward of said at least one variable 
reflectance rearview mirror, 

wherein said signal processor determines at least 
one control signal indicative of the desired 
reflectance level of the at least one variable 
reflectance rearview mirror from the first electrical 
signal indicative of the background light level and the 
second electrical signal indicative of the at least one 
peak light level; and 

at least one drive circuit connected to said 
signal processor and to said at least one variable 
reflectance rearview mirror for receiving said at least 
one control signal and generating and applying at least 
one drive signal to said at least one variable 
reflectance rearview mirror to drive said at least one 
variable reflectance mirror to the desired reflectance 
level. 
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2. The automatic rearview mirror system defined by 
Claim 1, further comprising an imaging system to focus 
an image of the area rearward of said at least one 
variable reflectance rearview mirror onto said array . 

3. The automatic rearview mirror system defined by 
Claim 2, wherein said imaging system comprises a lens. 

4. The automatic rearview mirror system defined by 
Claim 3, further comprising a semiconductor substrate 
on which said array of sensing elements is formed. 

5. The automatic rearview mirror system defined by 
Claim 4, wherein said imaging system is constructed 
integrally with said array of sensing elements. 

6. The automatic rearview mirror system defined by 
Claim 5, wherein said array of sensing elements and 
said signal processor are constructed on said 
semiconductor substrate as an integrated circuit. 

7. The automatic rearview mirror system defined by 
Claim 1, wherein said at least one variable reflectance 
rearview mirror is an electrochromic mirror. 

8. The automatic rearview mirror system defined by 
Claim 1, wherein said signal processor is an integrated 
circuit. 

9. The automatic rearview mirror system defined by 
Claim l, further comprising a memory, connected to said 
array and to said signal processor, receiving and 
storing the electrical signals output by said sensing 
elements, wherein said signal processor receives the 
electrical signals stored in said memory. 
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10. The automatic rearview mirror system defined by 
Claim 9, wherein said memory is a random-access-memory. 

11. The automatic rearview mirror system defined by 
Claim 1, wherein said signal processor is a 
microprocessor . 

12. The automatic rearview mirror system defined by 
Claim 1, further comprising a memory, connected to said 
array and said signal processor, receiving and storing 
the electrical signals output by said sensing elements, 

wherein said signal processor receives the 
electrical signals from said memory to determine the 
first and second electrical signals and stores the 
first and second electrical signals in said memory, 

wherein said signal processor receives the first 
and second electrical signals from said memory to 
determine the at least one control signal. 

13. The automatic rearview mirror system defined by 
Claim 1, wherein said signal processor determines said 
second electrical signal indicative of at least one 
peak light level in at least one zone of said area 
rearward of said at least one variable reflectance 
rearview mirror. 

14. The automatic rearview mirror system defined by 
Claim 13, 

wherein said signal processor determines a 
plurality of the second electrical signals indicative 
of a plurality of peak light levels, wherein each of 
the second electrical signals correspond to at least 
one zone of the area rearward of said at least one 
variable reflectance mirror, and 

wherein said signal processor determines and 
outputs a corresponding plurality of the control 
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signals based on the first and the plurality of second 
electrical signals* 

15 . The automatic rearview mirror system defined by 
Claim 1, wherein said signal processor samples the 
electrical signals indicative of the sensed light 
levels at a substantially constant sampling rate and 
varies the exposure time depending on the background 
light level in the area rearward of said at least one 
variable reflectance rearview mirror. 

16. The automatic rearview mirror system defined by 
Claim 1, wherein said array of sensing elements is a 
photosensor array and said sensing elements are 
photosensor elements arranged in a two-dimensional 
array of rows and columns, wherein each of said 
photosensor elements generates a photosensor element 
signal indicative of the light levels of light incident 
thereon . 

17. The automatic rearview mirror system defined by 
Claim 1, wherein said at least one variable reflectance 
rearview mirror comprises a plurality of segments each 
of whose reflectance is independently controllable by 
said signal processor, and wherein said signal 
processor controls each of the segments of said at 
least one variable reflectance rearview mirror using 
the electrical signals from a corresponding set of 
sensing elements of said array. 

18. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor determines the 
first electrical signal indicative of the background 
light level by calculating an average of the 
photosensor element signals indicative of the light 
levels of light incident on said photosensor elements 
in the lowest X rows of said photosensor array, wherein 
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X is a positive integer less than the number of rows in 
said photosensor array* 

19. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor determines the 
first electrical signal indicative of the background 
light level by calculating an average of X percent of 
the photosensor element signals indicative of the light 
levels of light incident on said photosensor elements, 
where X is a positive number. 

20. The automatic rearview mirror system defined by 
Claim 19 wherein X is approximately 100. 

21. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor determines the 
first electrical signal indicative of the background 
light level by calculating an average of X percent of 
photosensor element signals indicative of the lowest 
light levels of light incident on said photosensor 
elements, wherein X is a positive number. 

22. The automatic rearview mirror system defined by 
Claim 21, wherein X is between approximately 5 and 100. 

23. The automatic rearview mirror system defined by 
Claim 21, wherein X is approximately 75. 

24. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor determines the 
second electrical signal indicative of the at least one 
peak light level by determining the average value of Y 
percent of photosensor element signals indicative of 
the highest light levels of light incident on a 
predetermined set of said photosensor elements, wherein 
Y is a positive number. 
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25. The automatic rearview mirror system defined by 
Claim 24 , wherein Y is in the range of from 
approximately 1 to 25. 

26. The automatic rearview mirror system defined by 
Claim 24, wherein Y is approximately 10. 

27. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor determines said 
control signal according to the formula: 

V c (z) - Vj+ (Ri - S X Cr X B/P(z)) X (V 2 - V x ) / (R, - R 2 ) , 
wherein V c is the voltage of the at least one control 
signal determined by said signal processor, V x is the 
approximate voltage which, when applied to said at 
least one variable reflectance rearview mirror, causes 
said at least one variable reflectance rearview mirror 
to begin perceptibly decreasing its reflectance from 
its maximum reflectance level R w S is a sensitivity 
factor, Cj. is the maximum contrast ratio of the peak 
light level to the background light level, B is the 
background light level, P(z) is the at least one peak 
light level, and V 2 is the approximate voltage which, 
when applied to said at least one variable reflectance 
rearview mirror, causes said at least one variable 
reflectance rearview mirror to decrease its reflectance 
to approximately its minimum reflectance level R 2 . 

28. The automatic rearview mirror system defined by 
Claim 16, wherein said signal processor tests the 
photosensor element signal output from each photosensor 
element to determine whether the photosensor element 
signal output from each photosensor element is 
indicative of a peak light level or a background light 
level . 
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29. The automatic rearview mirror system defined by 
Claim 28 , further comprising an imaging system 
comprising a lens to focus an image of the area 
rearward of said at least one variable reflectance 
rearview mirror onto said photosensor array of 
photosensor elements, wherein said system further 
comprises means for applying a lens correction factor 
to each photosensor element signal output from each 
photosensor element. 

30. The automatic rearview mirror system defined by 
Claim 29, wherein the lens correction factor is in the 
range of approximately 1 to 15. 

31. The automatic rearview mirror system defined by 
Claim 28, wherein said signal processor determines a 
value indicative of the light level sensed by each 
photosensor element and compares each determined value 
with a predetermined peak threshold value to determine 
whether the photosensor element signal output from each 
photosensor element is indicative of a peak light level 
or a background light level. 

32. The automatic rearview mirror system defined by 
Claim 31, 

wherein said signal processor determines that a 
photosensor element signal output from one of said 
photosensor elements is indicative of a background 
light level when the determined value indicative of the 
sensed light level of said one of said photosensor 
elements is not greater than the peak threshold value, 
and 

wherein said signal processor determines that a 
photosensor element signal output from said one of said 
photosensor elements is indicative of a peak light 
level when the determined value indicative of the 
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sensed light level of said one of said photosensor 
elements is greater than the peak threshold value, 

33. The automatic rearview mirror system defined by 
Claim 32, wherein the peak threshold value is in the 
range of approximately 200 to 255 • 

34. The automatic rearview mirror system defined by 
Claim 31, wherein said signal processor determines the 
first electrical signal, indicative of a background 
light level by summing the determined values determined 
to be not greater than the peak threshold value and 
dividing the resulting sum by the number of determined 
values determined to be not greater than the peak 
threshold value. 

35. The automatic rearview mirror system defined by 
Claim 32, wherein said signal processor counts the 
number of determined values greater than the peak 
threshold value in a predetermined set of determined 
values corresponding to a predetermined set of 
photosensor elements and determines the second 
electrical signal indicative of the at least one peak 
light level in the area rearward of said at least one 
variable reflectance rearview mirror as a function of 
the number of determined values greater than the peak 
threshold value in the predetermined set of determined 
values. 

36. The automatic rearview mirror system defined by 
Claim 31, 

wherein said photosensor array means is located in 
said at least one variable reflectance rearview mirror 
so as to receive light through an active layer of said 
at least one variable reflectance rearview mirror from 
the area rearward of said at least one variable 
rearview reflectance mirror, and 
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wherein said signal processor applies a color 
correction factor to each value indicative of the 
sensed light level for each photosensor element to 
compensate for the reduction in transmitted light 
levels when the reflectance level of said at least one 
variable reflectance rearview mirror is reduced. 

37. The automatic rearview mirror system defined by 
Claim 16, 

wherein said signal processor uses the first 
electrical signal to determine a third electrical 
signal indicative of a change- limited background light 
level in the area rearward of said at least one 
variable reflectance rearview mirror, and 

wherein said signal processor determines the at 
least one control signal from the second and third 
electrical signals. 

38. The automatic rearview mirror system defined by 
Claim 37, 

wherein the automotive vehicle further comprises 
vehicle lighting, 

wherein said signal processor determines a vehicle 
lighting control signal using the third electrical 
signal, 

wherein said system further comprises at least one 
vehicle lighting switch, connected to said signal 
processor and to the vehicle lighting, receiving the 
vehicle lighting control signal from said signal 
processor and turning on or turning off the vehicle 
lighting in response thereto. 

39. The automatic rearview mirror system defined by 
Claim 1, wherein the light levels in the area rearward 
of said at least one variable reflectance rearview 
mirror comprise light levels from a rear window area, 
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at least a portion of a right side window area and at 
least a portion of a left side window area, and 

wherein said photosensor array has a two- 
dimensional field of view comprising said rear window 
area, said at least a portion of a right side window 
area and said at least a portion of a left side window 
area. 

40. The automatic rearview mirror system defined by 
Claim 39 , wherein said photosensor array comprises 40 
rows of said photosensor elements, each row comprising 
160 of said photosensor elements. 

41. The automatic rearview mirror system defined by 
Claim 1, wherein the system comprises a plurality of 
said drive circuits and the variable reflectance 
rearview mirrors, 

wherein said signal processor determines and 
outputs a plurality of the control signals to said 
plurality of said drive circuits, each of the control 
signals corresponding to a desired reflectance for each 
of said plurality of variable reflectance rearview 
mirrors, and 

wherein said plurality of said drive circuits, in 
response to the control signals, generate and apply a 
plurality of said drive signals to said plurality of 
variable reflectance rearview mirrors causing each of 
said variable reflectance rearview mirrors to assume a 
desired reflectance level associated therewith. 

42. The automatic rearview mirror system defined by 
Claim 41, wherein said photosensor array comprises a 
plurality of photosensor element sets, each of said 
sets corresponding to each of said plurality of 
variable reflectance rearview mirrors, 
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wherein said signal processor determines and 
outputs a plurality of said second electrical signals 
indicative of the at least the one peak light level, 

wherein said signal processor uses the first 
electrical signal indicative of the background light 
level and the plurality of said second electrical 
signals to determine and output the control signal for 
each of said plurality of said drive circuits and said 
variable reflectance rearview mirrors associated 
therewith . 

43. The automatic rearview mirror system defined by 
Claim 41, wherein said photosensor array comprises a 
first photosensor element set and a second photosensor 
element set, and a lens for focusing light from a rear 
window area and from at least a portion of a side 
window onto said photosensor array, 

wherein said signal processor determines a first 
peak light signal indicative of a peak light level of 
light incident on the first photosensor element set, 

wherein said signal processor determines a second 
peak light signal indicative of a peak light level of 
light incident on the second photosensor element set, 

wherein said signal processor determines and 
outputs a first control signal indicative of a desired 
reflectance level for one of said plurality of variable 
reflectance rearview mirrors using the first peak light 
signal and the first electrical signal indicative of 
the background light level, 

wherein said signal processor determines and 
outputs a second control signal indicative of a desired 
reflectance level for another of said plurality of 
variable reflectance rearview mirrors using the second 
peak light signal and the first electrical signal 
indicative of the background light level, 

wherein said first control signal is received by 
one of said plurality of drive circuits which generates 
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and applies a first drive signal to one of said 
plurality of variable reflectance rearview mirrors 
causing it to assume the desired reflectance level 
associated therewith, and 

wherein said second control signal is received by 
another of said plurality of drive circuits which 
generates and applies a second drive signal to another 
of said plurality of variable reflectance rearview 
mirrors causing it to assume the desired reflectance 
level associated therewith. 

44. The automatic rearview mirror system defined by 
Claim 43, wherein said plurality of variable 
reflectance rearview mirrors comprise a rearview 
mirror, a left side view mirror and a right side view 
mirror , 

wherein said photosensor array further comprises a 
third photosensor element set, 

wherein said light focused from said at least a 
portion of a side window area comprises light from at 
least a portion of a left side window area and light 
from at least a portion of a right side window area, 

wherein said signal processor determines a first 
peak light signal indicative of a peak light level 
incident on the first photosensor element set, 

wherein said signal processor determines a second 
peak light signal indicative of a peak light level 
incident on the second photosensor element set, 

wherein said signal processor determines a third 
peak light signal indicative of a peak light level 
incident on the third photosensor element set, 

wherein said signal processor determines and 
outputs first, second and third control signals 
indicative of a desired reflectance for said rearview 
mirror, said left side view mirror and said right side 
view mirror, respectively, using each of the first, 
second, and third peak light signals and the first 
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electrical signal indicative of the background light 
level, 

wherein each of the first, second and third 
control signals are output to each of said drive 
circuits associated therewith to generate and apply a 
first, second and third drive signal to said rearview 
mirror, said left side view mirror, and said right side 
view mirror, respectively, causing said mirrors to 
assume the desired reflectance level associated 
therewith . 

45, The automatic rearview mirror system defined by 
Claim 1, wherein said array of sensing elements 
comprises an analog photosensor array of photosensor 
elements, each of said photosensor elements generating 
analog photosensor element signals in response to light 
incident thereon, 

wherein said system further comprises an analog- 
to-digital converter connected to said analog 
photosensor array and said signal processor to convert 
the analog photosensor element signals to digital 
photosensor element signals, 

wherein said signal processor determines the first 
electrical signal indicative of the background light 
level using the digital photosensor element signals, 

wherein said signal processor determines the 
second electrical signal indicative of at least one 
peak light level using the digital photosensor element 
signals, 

wherein the control signal determined by said 
signal processor is a digital control signal, 

wherein said system further comprises a digital- 
to-analog converter connected to said signal processor 
and to said at least one drive circuit to convert the 
digital control signal to an analog control signal, and 

wherein said at least one drive circuit receives 
the analog control signal and in response thereto 
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generates and applies a drive signal to said at least 
one variable reflectance rearview mirror to vary its 
reflectance level . 

46. A control system for controlling a plurality of 
variable reflectance mirrors, each of which change 
their reflectance level in response to a drive signal 
from an associated drive circuit, for an automotive 
vehicle , comprising : 

a plurality of variable reflectance mirrors; 

a photosensor array mountable to face 
substantially towards a rear area, wherein said 
photosensor array comprises a plurality of photosensor 
element sets, each set comprising a plurality of 
photosensor elements, each of said photosensor elements 
generating a photosensor element signal indicative of a 
light level of light incident thereon, and each of the 
sets corresponding to one of said plurality of variable 
reflectance mirrors, 

a control circuit, connected to said photosensor 
array, for determining and applying a plurality of 
control signals, each of the control signals indicative 
of a desired reflectance level for each of said 
plurality of variable reflectance mirrors in response 
to receiving the photosensor element signals from each 
of the plurality of photosensor element sets, 

a plurality of drive circuits connected to said 
control circuit and to different ones of said plurality 
of variable reflectance mirrors associated therewith, 

wherein each of the control signals is output to 
said drive circuit associated therewith, to generate 
and apply a drive signal to each of said plurality of 
variable reflectance mirrors causing each of said 
mirrors to assume a reflectance level. 

47. The control system defined by Claim 46, wherein 
said control circuit determines a background light 
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signal indicative of a background light level in 
response to receiving the photosensor element signals 
from at least one of the photosensor element sets, 

wherein said control circuit determines a 
plurality of peak light signals, each of said peak 
light signals being indicative of a peak light level 
incident on each of the photosensor element sets, 

wherein said control circuit determines a 
plurality of control signals, each of the control 
signals determined by using the background light signal 
and one of the plurality of peak light signals, 
associated with each of the plurality photosensor 
element sets, 

wherein said control circuit applies each of the 
plurality of control signals to a drive circuit 
associated therewith, each of said drive circuits 
generating and applying a drive signal to each of said 
variable reflectance mirrors associated therewith. 

48. The control system defined by Claim 47, wherein 
said photosensor array comprises a first set and a 
second set of photosensor elements, and a lens for 
focusing light from a rear window area onto said 
photosensor array, 

wherein said control circuit determines a first 
peak light signal indicative of a peak light level 
incident on the first photosensor element set in 
response to receiving photosensor element signals from 
the first photosensor element set, 

wherein said control circuit determines another 
peak light signal indicative of another peak light 
level incident on the second photosensor element set in 
response to receiving photosensor element signals from 
the second photosensor element set, 

wherein said control circuit determines a first 
control signal indicative of a desired reflectance for 
one of said plurality of variable reflectance mirrors 
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using the first peak light signal and the background 
light signal, 

wherein said control circuit determines a second 
control signal indicative of another desired 
reflectance for another of said plurality of variable 
reflectance mirrors using the another peak light signal 
and the background light signal, 

wherein the first control signal controls a first 
drive circuit to generate a first drive signal in 
response to which said one of said plurality of 
variable reflectance mirrors is driven to the desired 
reflectance associated therewith, and 

wherein said second control signal controls a 
second drive circuit to generate a second drive signal 
in response to which said another of said plurality of 
variable reflectance mirrors is driven to the desired 
reflectance associated therewith, 

49. The control system defined by Claim 48, wherein 
said plurality of variable reflectance mirrors comprise 
a rearview mirror, a left side view mirror and a right 
side view mirror, 

wherein said light from at least one side window 
area comprises light from a left side window area and 
light from a right side window area, 

wherein said photosensor array further comprises a 
third photosensor element set, each of said photosensor 
elements generating a photosensor element signal 
indicative of a light level incident thereon, 

wherein said control circuit determines a first 
peak light signal indicative of a peak light level 
incident on the first photosensor element set in 
response to receiving photosensor element signals from 
the first photosensor element set, 

wherein said control circuit determines a second 
peak light signal indicative of a second peak light 
level incident on the second photosensor element set in 
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response to receiving photosensor element signals from 
the second photosensor element set, 

wherein said control circuit determines a third 
peak light signal indicative of a third peak light 
level incident on the third photosensor element set in 
response to receiving photosensor element signals from 
the third photosensor element set, 

wherein said control circuit determines a first 
control signal indicative of a desired reflectance 
level of said rearview mirror using the first peak 
light signal and the background light signal, 

wherein said control circuit determines a second 
control signal indicative of a desired reflectance 
level of said left side view mirror using the second 
peak level signal and the background light signal, 

wherein said control circuit determines a third 
control signal indicative of a desired reflectance 
level of said right side view mirror using the third 
peak light signal and the background light signal, 

wherein said first control signal controls a first 
drive circuit to generate a first drive signal in 
response to which said rearview mirror is driven to the 
desired reflectance level associated therewith, 

wherein said second control signal controls a 
second drive circuit to generate a second drive signal 
in response to which said left side view mirror is 
driven to the desired reflectance level associated 
ther ew i t h , and 

wherein said third control signal controls a third 
drive circuit to generate a third drive signal in 
response to which said right side view mirror is driven 
to the desired reflectance level associated therewith. 

50. A control system for controlling at least one 
variable reflectance mirror for an automotive vehicle , 
comprising: 
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photosensor array means for sensing light levels 
in an area rearward of said at least one variable 
reflectance mirror and generating photosensor array 
signals, 

means for determining a background light signal 
from the photosensor array signals; 

means for determining a peak light signal from the 
photosensor array signals; and 

means for controlling a reflectance level of the 
at least one variable reflectance mirror using the 
background and peak light signals. 

51. The control system defined by Claim 50, wherein 
said controlling means comprises: 

desired reflectance level determining means for 
determining a desired reflectance level for the at 
least one variable reflectance mirror by using said 
background and peak light signals; and 

desired reflectance control means for controlling 
the reflectance level of the at least one variable 
reflectance mirror using the determined desired 
ref lectance level . 

52. The control system defined by Claim 51, 
wherein said photosensor array means comprises a 

plurality of photosensor elements arranged in a two- 
dimensional array of rows and columns, each of said 
plurality of photosensor elements generating a 
photosensor element signal indicative of a light level 
incident thereon, 

wherein said means for determining a background 
light signal determines the background light signal by 
calculating an average of the photosensor element 
signals corresponding to the light levels incident on 
said photosensor elements in the lowest X rows of said 
photosensor array means, wherein X is a positive 
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integer less than the number of rows in said 
photosensor array means. 

53. The control system defined by Claim 51, 
wherein said photosensor array means comprises a 

plurality of photosensor elements, each photosensor 
element generating a photosensor element signal 
indicative of a light level of light incident thereon, 

wherein said means for determining a background 
light signal determines a background light signal by 
calculating an average of X percent of the photosensor 
element signals, wherein X is a positive number. 

54. The control system defined by Claim 53, wherein X 
is approximately 100. 

55. The control system defined by Claim 51, wherein 
said photosensor array means comprises a plurality of 
photosensor elements, each photosensor element 
generating a photosensor element signal indicative of a 
light level of light incident thereon, 

wherein said means for determining a background 
light signal determines a background light signal by 
calculating an average of X percent of the photosensor 
element signals indicative of the lowest light levels 
incident on said photosensor elements, wherein X is a 
positive number. 

56. The control system defined by Claim 55, wherein X 
is between approximately 5 and 100. 

57. The control system defined by Claim 55, wherein X 
is approximately 75. 

58. The control system defined by Claim 51, wherein 
said photosensor array means comprises a plurality of 
photosensor elements for sensing light levels in an 
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area rearward of said at least one variable reflectance 
mirror , each photosensor element generating photosensor 
element signals indicative of a light level incident 
thereon, 

wherein said means for determining a peak light 
signal determines a peak light signal by determining 
the average value of Y percent of the photosensor 
element signals indicative of the highest light levels 
of light incident on a predetermined set of said 
photosensor elements, wherein Y is a positive number. 

59. The control system defined by Claim 58, wherein Y 
is in the range of approximately 1 to 25. 

60. The control system defined by Claim 58, wherein Y 
is approximately 10. 

61. The control system defined by Claim 51, wherein 
said desired reflectance level determining means 
determines a control signal indicative of the desired 
reflectance level according to the formula: 

V c (2) = V x + (R x - S X C T X B/P(z)) X (V 2 - V^/iR, - R 2 ), 

wherein V c is the voltage of the at least one control 
signal determined by said signal processor, Vj is the 
approximate voltage which, when applied to said at 
least one variable reflectance mirror, causes said at 
least one variable reflectance mirror to begin 
perceptibly decreasing its reflectance from its maximum 
reflectance level R lf s is a sensitivity factor, C T is 
the maximum contrast ratio of the peak light level to 
the background light level, B is the background light 
level, P(z) is the at least one peak light level, and V 2 
is the approximate voltage which, when applied to said 
at least one variable reflectance mirror, causes said 
at least one variable reflectance mirror to decrease 
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its reflectance to approximately its minimum 
reflectance level R 2 . 

62. The control system defined by Claim 51, wherein 
said desired reflectance level determining means tests 
the photosensor array signals to determine whether each 
photosensor array signal is indicative of a peak light 
level or a background light level. 

63. The control system defined by Claim 62, further 
comprising an imaging system comprising a lens to focus 
an image of the area rearward of said at least one 
variable reflectance mirror onto said photosensor array 
means, and means for applying a lens correction factor 
to each photosensor array signal. 

64. The control system defined by Claim 63, wherein 
the lens correction factor is in the range of 
approximately 1 to 15. 

65. The control system defined by Claim 62, wherein 
said desired reflectance level determining means 
determines a value indicative of the sensed light level 
corresponding to each photosensor array signal and 
compares each determined value with a predetermined 
peak threshold value to determine whether each 
photosensor array signal is indicative of a peak light 
level or a background light level. 

66. The control system defined by Claim 65, 

wherein said desired reflectance level determining 
means determines that a photosensor array signal is 
indicative of a background light level when the 
determined value indicative of the sensed light level 
corresponding to one of the photosensor array signals 
is not greater than the peak threshold value, and 
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wherein said desired reflectance level determining 
means determines that a photosensor array signal is 
indicative of a peak light level when the determined 
value indicative of the sensed light level 
corresponding to the one of the photosensor array 
signals is greater than the peak threshold value* 

67. The control system defined by Claim 66, wherein 
the peak threshold value is in the range of 
approximately 200 to 255. 

68. The control system defined by Claim 66, wherein 
said desired reflectance level determining means 
determines the background light signal by summing the 
determined values determined to be not greater than the 
peak threshold value and dividing the resulting sum by 
the number of determined values determined to be not 
greater than the peak threshold value. 

69. The control system defined by Claim 66, wherein 
said desired reflectance level determining means counts 
the number of determined values greater than the peak 
threshold value in a predetermined set of determined 
values corresponding to a predetermined set of 
photosensor elements of said photosensor array means 
and determines the peak light signal in the area 
rearward of the at least one variable reflectance 
mirror as a function of the number of determined values 
greater than the peak threshold value in the 
predetermined set of determined values. 

70. The control system defined by Claim 65, 

wherein said photosensor array means is located in 
the at least one variable reflectance mirror so as to 
receive light through an active layer of said at least 
one variable reflectance mirror from the area rearward 
of said at least one variable reflectance mirror, and 
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wherein said desired reflectance level determining 
means applies a color correction factor to each value 
indicative of the sensed light level for each 
photosensor array signal to compensate for the 
reduction in transmitted light levels when the 
reflectance level of the at least one variable 
reflectance mirror is reduced. 

71. The control system defined by Claim 51, 

wherein said desired reflectance level determining 
means uses the background light signal to determine a 
change-limited background light signal, and 

wherein said desired reflectance level determining 
means uses the change- limited background signal to 
determine the desired reflectance level. 

72. The control system defined by Claim 51, further 
comprising means for determining a plurality of peak 
light signals, wherein said means for determining a 
desired reflectance determines the desired reflectance 
for a plurality of variable reflectance mirrors using 
the background light signal and the plurality of the 
peak light signals, and 

wherein said desired reflectance control means 
controls each of said plurality of variable reflectance 
mirrors using the desired reflectance for each of said 
plurality of variable reflectance mirrors. 

73. The control system defined by Claim 72, wherein 
said photosensor array means comprises a first set and 
a second set of photosensor elements, and a lens for 
focusing light from a rear window area and from at 
least a portion of a side window onto said photosensor 
array means, each photosensor element generating a 
photosensor element signal indicative of a light level 
incident thereon, 
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wherein said means for determining a plurality of 
peak light signals determines a peak light signal 
indicative of a peak light level of light incident on 
the first photosensor element set from photosensor 
element signals of the first set and determines another 
peak light signal indicative of another peak light 
level of light incident on the second photosensor 
element set from photosensor element signals of the 
second set, 

wherein said means for determining a desired 
reflectance determines the desired reflectance for one 
of said variable reflectance mirrors using the peak 
light signal corresponding to the first photosensor 
element set and the background light signal, and 

wherein said means for determining a desired 
reflectance determines the desired reflectance for 
another of said variable reflectance mirrors using the 
peak light signal corresponding to the second 
photosensor element set and the background light level. 

74. The control system defined by Claim 73, wherein 
the plurality of variable reflectance mirrors comprises 
a rearview mirror, a left side view mirror and a right 
side view mirror, wherein said light from a side window 
area comprises light from at least a portion of a left 
side window area and light from at least a portion of a 
right side window area, 

wherein said photosensor array means comprises a 
third set of photosensor elements, each of said 
photosensor elements generating a photosensor element 
signal indicative of a light level incident thereon, 

wherein said means for determining a plurality of 
peak light signals determines a first peak light signal 
indicative of a peak light level of light incident on 
the first photosensor element set, a second peak light 
signal indicative of a peak light level of light 
incident on the second photosensor element set and a 
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third peak light signal indicative of a peak light 
level of light incident on said third photosensor 
element set from photosensor element signals 
associated , respectively, with the first, second and 
third photosensor element sets, 

wherein said means for determining a desired 
reflectance determines a desired reflectance of said 
rearview mirror using the first peak light signal and 
the background light signal, 

wherein said means for determining a desired 
reflectance determines a desired reflectance of said 
left side mirror using the second peak light signal and 
the background light signal, 

wherein said means for determining a desired 
reflectance determines a desired reflectance of said 
right side mirror using the third peak light signal and 
the background light signal, and 

wherein said desired reflectance control means 
controls the rearview mirror, the left side mirror, and 
the right side mirror, respectively, using the desired 
reflectances of the rearview mirror, the left side 
mirror, and the right side mirror. 

75. The control system defined by Claim 51, wherein 
said photosensor array signals are analog signals, 

wherein said system further comprises analog-to- 
digital conversion means for converting the analog 
photosensor array signals to digital photosensor array 
signals, 

wherein said means for determining a background 
light signal determines a background light signal from 
the digital photosensor array signals, and 

wherein said means for determining a peak light 
signal determines a peak light signal the digital 
photosensor array signals, 
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wherein said desired reflectance level determining 
means determines the desired reflectance level and 
produces a digital control signal indicative thereof, 

wherein said system further comprises digital-to- 
analog conversion means to convert the digital control 
signal to an analog control signal, and 

wherein said desired reflectance control means 
controls the reflectance level of the at least one 
variable reflectance mirror using the analog control 
signal. 

76. A method of controlling the reflectance of at 
least one variable reflectance mirror comprising the 
steps of: 

sensing light levels in an area rearward of the at 
least one variable reflectance mirror with an array of 
sensing elements; 

determining a background light level from the 
sensed light levels; 

determining a peak light level from the sensed 
light levels; and 

controlling a reflectance level of the at least 
one variable reflectance mirror using the determined 
background and peak light levels. 

77. The method defined by Claim 76, 

wherein the array has a plurality of rows of 
sensing elements, and 

wherein said step of determining a background 
light level comprises the step of determining the 
background light level by calculating an average of the 
sensed light levels in the lowest X rows of the array, 
wherein X is a positive integer less than the number of 
rows in the array. 

78. The method defined by Claim 76, wherein said step 
of determining a background light level comprises the 
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step of determining a background light level by 
calculating an average of X percent of the sensed light 
levels, wherein X is a positive number. 

79. The method defined by Claim 76 , wherein said step 
of determining a background light level comprises the 
step of determining a background light level by 
calculating an average of X percent of the lowest 
sensed light levels, wherein X is a positive number. 

80. The method defined by Claim 76 , wherein said step 
of determining a peak light level comprises the step of 
determining a peak light level by calculating an 
average of Y percent of the sensed light levels 
indicative of the highest sensed light levels, wherein 
Y is a positive number. 

81. The method defined by Claim 76, 

wherein the at least one variable reflectance 
mirror changes it reflectance in response to the 
application of a voltage thereto, 

wherein said controlling step determines a desired 
reflectance level for the at least one variable 
reflectance mirror according to the formula: 

V c (z) - V x + (R x - S x C T x B/P(z)) x (V 2 - VJ/CR, - R 2 ) , 

wherein V c (z) is a voltage representing the desired 
reflectance level, V! is the approximate voltage which, 
when applied to the at least one variable reflectance 
mirror, causes the at least one variable reflectance 
mirror to begin perceptibly decreasing its reflectance 
from its maximum reflectance level R w S is a 
sensitivity factor, C T is the maximum contrast ratio of 
the peak light level to the background light level B is 
the determined -background light level, P(z) is the 
determined peak light level, and V 2 is the approximate 
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voltage which , when applied to the at least one 
variable reflectance mirror, causes the at least one 
variable reflectance mirror to decrease its reflectance 
to approximately its minimum reflectance level R 2/ 

wherein said controlling step comprises the step 
of applying the voltage V c (z) to the at least one 
variable reflectance mirror to cause the at least one 
variable reflectance mirror to assume the determined 
desired reflectance level. 

82. The method defined by Claim 76, 

wherein said sensing step comprises the step of 
sensing the light level of light incident on each 
sensing element of the array, and 

wherein said method further comprises the step of 
testing the light level sensed by each sensing element 
of the array to determine whether each light level is 
indicative of a peak light level or a background light 
level. 

83. The method defined by Claim 82, wherein said 
testing step comprises the step of comparing each 
sensed light level of each sensing element of the array 
with a predetermined peak threshold value to determine 
whether each light level is indicative of a peak light 
level or a background light level. 

84. The method defined by Claim 83, 

wherein said testing step comprises the step of 
determining that a sensed light level of a sensing 
element is indicative of a background light level when 
the sensed light level is not greater than the peak 
threshold value, and 

wherein said testing step further comprises the 
step of determining that a sensed light level of a 
sensing element is indicative of a peak light level 
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when the sensed light level is greater than the peak 
threshold value. 

85. The method defined by Claim 84, wherein said 
background light level determining step comprises the 
step of determining a background light level by summing 
the sensed light levels sensed by each sensing element 
that are determined to be not greater than the peak 
threshold value and dividing the resulting sum by the 
number of sensed light levels determined to be not 
greater than the peak threshold value. 

86. The method defined by Claim 85, wherein said peak 
light level determining step comprises the steps of 
counting the number of sensed light levels greater than 
the peak threshold value in a predetermined set of 
sensed light levels corresponding to a predetermined 
set of sensing elements of the array, and determining a 
peak light level in the area rearward of the at least 
one variable reflectance mirror as a function of the 
number of sensed light levels greater than the peak 
threshold value in the predetermined set. 

87. The method defined by Claim 76, further comprising 
the step of : 

determining a plurality of peak light levels for a 
plurality of areas rearward of the at least one 
variable reflectance mirror, 

wherein said controlling step comprises the step 
of determining a desired reflectance for each of a 
plurality of variable reflectance mirrors using the 
determined background light level and the plurality of 
peak light levels, and 

wherein said controlling step further comprises 
the step of controlling the reflectance of each of the 
plurality of variable reflectance mirrors using the 
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determined desired reflectance for each of the 
plurality of variable reflectance mirrors. 

88. A control system for monitoring a vehicle interior 
and for controlling at least one variable reflectance 
mirror for an automotive vehicle, comprising: 

photosensor array means for sensing light levels 
in an area rearward of said photosensor array means and 
generating at least a first set of photosensor array 
signals; 

first determining means coupled to said 
photosensor array means for receiving said at least a 
first set of photosensor array signals and determining 
from at least a portion of said at least a first set of 
photosensor array signals a first signal for 
controlling said at least one variable reflectance 
mirror; 

second determining means coupled to said 
photosensor array means for receiving said at least a 
first set of photosensor array signals and determining 
at least a first set of values indicative of said at 
least a portion of said at least a first set of 
photosensor array signals; and 

memory means coupled to said second determining 
means for receiving and storing said at least a portion 
of said at least a first set of photosensor array 
signals. 

89. A vehicle intrusion detection system for detecting 
movement within a vehicle interior for an automotive 
vehicle, comprising: 

photosensor array means for sensing light levels 
in an area including at least a portion of a vehicle 
interior and generating at least a first set and a 
second set of photosensor array signals; 

determining means coupled to said photosensor 
array means for receiving said at least a first set and 
a second set of photosensor array signals and 
determining at least a first set and a second set of 
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values indicative of said at least a first set and a 
second set of photosensor array signals; and 

comparing means coupled to said determining means 
for receiving said at least a first set and a second 
set of values indicative of said at least a first set 
and a second set of photosensor array signals and 
comparing said at least a first set and a second set of 
values to generate at least one output control signal 
indicative of the correlation between said at least a 
first set and a second set of values. 

90. A compartment image data storage system for an 
automotive vehicle, comprising: 

photosensor array means for sensing light levels 
in at least a portion of a vehicle compartment and 
generating at least a first set of photosensor array 
signals; 

determining means coupled to said photosensor 
array means for receiving said at least a first set of 
photosensor array signals and determining at least a 
first set of values indicative of said at least a first 
set of photosensor array signals; and 

memory means coupled to said determining means for 
receiving and storing said at least a first set of 
values indicative of said at least a first set of 
photosensor array signals. 

91. An automatic rearview mirror system for an 
automotive vehicle comprising: 

a variable reflectance rearview mirror,; 

a photosensor array means for sensing light levels 
in an area rearward of said variable reflectance 
rearview mirror and for generating photosensor array 
signals; 

a signal processing means for receiving said 
photosensor array signals and for determining from said 
photosensor array signals a signal for controlling said 
variable reflectance rearview mirror; and 
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a mounting bracket means for attaching said 
variable reflectance rearview mirror to said automotive 
vehicle, said mounting bracket means further comprising 
a housing means for housing said photosensor array 
means and said signal processing means. 

92. A vehicle lighting control system for controlling 
a vehicle lighting system in an automotive vehicle 
comprising: 

a photosensor array means for sensing light levels 
in a forward field of view and generating a set of 
photosensor array signals; and 

a signal processing means coupled to said 
photosensor array means for receiving said set of 
photosensor array signals and determining from said set 
of photosensor array signals at least one control 
signal for controlling said vehicle lighting system. 
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ABSTRACT OF THE DISCLOSURE 

A system apparatus, means and method for controlling a 
plurality of variable reflectance mirrors (or mirror 
5 segments) , including a rearview mirror and side view 
mirrors, which change their reflectance level in 
response to a plurality of drive voltages applied 
thereto, for controlling the vehicle lighting system 
and for monitoring a vehicle interior for an automotive 

10 vehicle. The system includes a light sensing device 
and a control circuit formed as a single VLSI CMOS 
circuit. The light sensing device comprises a 
photosensor array having a field of view encompassing a 
vehicle interior. The logic and control circuit 

15 determines a background light signal from photosensor 
element signals generated by the photosensor elements 
in the photosensor array indicative of light levels 
incident on the photosensor elements. The circuit also 
determines a peak light signal in three different zones 

20 or sub-arrays of the photosensor array. The zones or 
sub-arrays may correspond to three mirrors or mirror 
segments. The peak light signals in each of the zones 
and a common background light signal are used to 
determine independent and separate control signals, 

25 which are then output to separate mirror drive circuits 
for independently controlling the reflectance level of 
the rearview mirror and the left and right side view 
mirrors, or alternatively the segments of a mirror. 
The logic and control circuit uses the background light 

3 0 signal to control the vehicle lighting system. The 
logic and control circuit also determines a vehicle 
intrusion condition if there is movement within the 
vehicle in a vehicle intrusion detection mode of the 
vehicle interior monitoring system. The logic and 

35 control circuit also stores image data in memory in the 
compartment image data storage mode of the vehicle 
interior monitoring system. 
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(Registration No. 38,586), Brian L. Klock (Registration No. 36,570), Anne M. Maher (Registration No. 38,231), William J. Zak, Jr. 
(Registration No. 38,668), Thomas D. Pease (Registration No. 35,317), Bruce M. Wexler (Registration No. 35,409), and Robert S. 
Mayer (Registration No. 38,544). 



Address all correspondence to: 

FITZPATRICK, CELLA, HARPER & SCINTO 

277 Park Avenue 
New York, N.Y. 10172 
Telephone No. (212) 758-2400 
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I hereby declare that all statements made herein of my own knowledge 
are true and that all statements made on information and belief are believed to be 
true; and further that these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine or imprisonment, or 
both, under Section 1001 of Title 18 of the United States Code and that such willful 
false statements may jeopardize the validity of the application or any patent issued 
thereon. 



Full Name of Sole or First Inventor KENNETH s chofield 
Inventor's signature (<L.P//uh c ^Q£qq 




Date fSfk Xpfr^brr (33 SI Citizen/Subject of Great Britain 
Residence 4793 Crestridge Court. Holland, Michigan 49423 — 

Post Office Address . 



Full Name of Second Joint InventorJfa^MRK LARSON 

Second Inventor's signature ^WA 

Date I^gf^fg^g^I B^Hi Citizen/Subject of USA 

Residence 13873 Oakwood circle. Gra nd Haven. Michigan 49417 



Post Office Address 



ES01\W99080\dew 



